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THE CONDITIONS OF BELIEF IN ADVfiKTJSING 



A reader of the literature dealing with the Psychology of Ad- 
vertising finds numerous articles written upon the effectiveness 
of various mechanical devices, the attention and memory value 
of size of space and the position on the page, the influence of 
color, style of type and its arrangement, the efFectiveness of 
repeating the advertisement, etc. The problem of arousing the 
confidence of the consumer in the article advertised, the condi- 
tions on which it depends, how i>elief in advertisements may be 
created and how it may be measured have been very, lightly 
touched in experimental studies. The importance of these mat- 
ters is emphasized in every textbook on advertising. The fact 
that the American people are each year induced to squander 
many millions of dollars in worthless securities through the 
medium of advertising in some form, and that warnings seem 
quite ineffective in protecting them, makes one curious about the 
basis of belief in advertising. It is not enough to say that the 
American people like to be fooled and that there is no scheme 
too wild to arouse the confidence of a large proportion of them- 
The advertiser should know that action is dependent upon belief 
and that belief in advertising depends upon conditions, some of 
which at least are under his control. 

Belief is indeed a complex mental state and it may depend at 
any time upon a great variety of factors, the most common of 
which are listed in textbooks of psychology and advertising. It 
is not the purpose of this report to repeat such lists but to cite 
Bome experimental evidence from the field of advertising to show 
the importance of a few of the conditions of belief for success in 
advertising. 

1, Belief is rarely the result of reasoning. One does not go 
through the processes of logic to establish his beliefs. If logic is 
used at .ill it is to justify a belief already established. A strik- 
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A reader of the literature dealing with the Psychology of Ad- 
vertising finds numerous articles written upon the effectiveness 
of various mechanical devices, the attention and memory value 
of size of apace and the position on the page, the influence of 
color, style of type and its arrangement, the effectiveness of 
repeating the advertisement, etc. The problem of arousing the 
Gonfldence of the consumer in the article advertised, the condi- 
tions on which it depends, how belief in advertisements may be 
created and how it may be measured have been very, lightly 
touched in experimental studies. The importance of these mat- 
ters is emphasized in every textbook on advertising. The fact 
that the American people are each year induced to squander 
many millions of dollars In worthless securities through the 
medium of advertising in some form, and that warnings seent 
quite ineffective in protecting them, makes one curious about the 
basis of belief in advertising. It is not enough to say that the 
American people like to be fooled and that there is no scheme 
too wild to arouse the confidence of a large proportion of them. 
The advertiser should know that action is dependent upon belief 
and that belief in advertising depends upon conditions, some of 
which at least are under his control. 

Belief is indeed a complex mental state and it may depend at 
any time upon a great variety of factors, the most common of 
which are listed in textbooks of psychology and advertising. It 
is not the purpose of this report to repeat such lists but to cite 
some experimental evidence from the field of advertising to show 
the importance of a few of the conditions of belief for success in 
advertising. 

1, Belief is rarely the result of reasoning. One does not go 
through the processes of logic to establish his beliefs. If logic is 
used at all it is to justify a belief already established. A strik- 
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ing iUustratiofi of the separation- of. reasoning and belief is found 
in the case of the insane pat^ipnt who firmly believed himself to 
be the son of a king, arjf-'pet "wEiose reason was intact enough to 
enable him to aolve qo;iipiiicated mathematical problems. 

The advertising -irf tKe New Gillette razor offered a good oppor- 
tunity for studying. tlie relation between belief and reasoning.' On 
May 16, 1921, '.the Gillette Razor Company announced "a new 
triumph -.of., 'American inventive genius of startling interest to 
every -Waft ■ with a beard to shave." The advertisements state 
tlJaV■t^6 "fulcrum shoulder, overhanging cap and channeled 
-^SHkrd" were the three innovations which made possible "for the 
■ ;_first time in any razor, micrometric control of blade position." A 
■diagram showed "how the blade is biflexed between overhanging 
■cap and fulcrum shoulder. It is flexed once into the inside curve 
■of the cap. This is the minor flexure — the curve for easy gliding 
action and play of the wrist in shaving. It is flexed a second 
time — more sharply and in a shorter radius — by the grip of the 
■overhanging cap the whole length of the fulcrum shoulder. This 
is the major flexure." This arrangement provided an exactness 
of adjustment to 1-1000 of an inch. Advertisements containing 
the above information and well illustrated were given to fifty- 
seven men, college students and university graduates, together 
with a series of seven questions intended to teat both their belief 
in the new razor and their understanding of it. The answers to 
these questions showed that all the students agreed that the new 
razor was better than the old one, and that they would rather pay 
S5.00 for the new one than ?1.00 or (2.00 for the old one. In 
supicrting their belief they were allowed to consult the advertise- 
ment as much as they wished. They quoted the "fulcrum shoulder, 
overhanging cap and channeled guard," which made possible 
"micrometric control of blade position," but not one of them could 
explain how the micrometric control was obtained or what ad- 
vantage there would be in having such micrometric control. They 
believed that the "channel guard" was an improvement although 
they could not tell why it was an improvement. As to the import- 
ance of major and minor fiexurea they were entirely ignorant, 
Five minutes examination of an enlarged diagram of the new razor 
improved their understanding of the razor little or not at all. 
Here is a belief effective for the purpose of the advertiser in 
spite of the inability of the reader to support his belief with 
reason. This experiment is quoted not to show that the adver- 
tisement is poor, but merely to show that in advertising reasun- 
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ing is not needed to create belief. Whether the space in the ad- 
vertisement devoted to argument mif^ht have been more prolitably 
filled, is however an interesting question. 

2, It is not necessarily that which is true that is believed. 
The fact that a statement in an advertisement is true will not 
guarantee belief on the part of the readers of it. The truth may 
be too startling and surprising to be believed, and in some cases it 
might be more effective to tell half the truth than the whole truth. 
Three advertisements were chosen for investigation in this con- 
nection, each of them presenting rather unusual information. In 
each case the truth of the statements made was vouched for by 
reliable individuals. Each of the advertisements was present<':d 
to 100 people, together with a series of statements about them. 
The individuals were to simply check those statements that most 
nearly represented their opinion about the advertisements. The 
statements were carefully prepared so as to avoid suggestion. The 
studies of the three advertisements will be reported separately: 

Taylor Trunk Advertisement. This advertisement showed the 
photograph of a huge elephant standing on a trunk. The picture 
was accompanied by a signed statement as to the genuineness of 
the photograph, and by statements to the effect that the trunk 
was taken from the regular stock. Statistical treatment of the 
replies of the persons tested showed that 38 percent of them 
doubted the truth of the statements made in the advertisement; 
24 per cent questioned the genuineness of the photograph; and 
21 percent believed that it would be impossible to construct a 
^trunk strong enough to withstand such a weight. That is, in from 
one-fifth to two-fifths of the persons tested the advertisement cre- 
ated a state of mind adverse to the purchase of the article, 

Stanley Vacuum Bottle Advertisement. This advertisement rep- 
resented a vacuum bottle falling from a high window, and de- 
scribed an incident in which a Stanley bottle had accidentally 
fallen from an eighth story window and suffered only a dent, 
which did not at all interfere with its usefulness. The replies to 
the questions submitted with this advertisement showed that 31 
percent doubted the truth of the statements, while 22 percent 
refused to believe that a vacuum bottle sufficiently strong to sur- 
vive the fall could possibly be constructed. 

Edison Phono grapK Advertisement. This advertisement pic- 
tured one of the well known "tone tests" demonstrations in Car- 
negie Hall, Pittsburg. It showed the stage occupied by a well 
known singer and an Edison phonograph, with the audience in the 
background. On the advertisement there were reproduced a 
nnmber of clippings from the daily papers describing the remark- 
able demonstration, each clipping making the statement in one 
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form or another that no one in the audience of 2,600 people could 
distinguish between the voice of the singer and its reproduction. 
Replies from 100 people to eight questions about this advertise- 
ment may be summed up as follows: 77 percent doubted the 
truth of the statements contained in the advertisements. 73 per- 
cent believed that they could tell the difference between a real 
voice and its reproduction by any phonograph. 82 percent be- 
lieved that mechanical sounds would betray the phonograph in 
these "tone tests," 49 percent believed that some form of trickery 
or deception was practiced. 50 percent believed that the artist 
intentionally imitated the phonograph. 44 percent believed that 
a specially constructed phonograph was used for the demonstra- 
tion rather than a stock instrument. 68 percent believed that no 
phonograph could successfully undergo such a tost. 39 percent 
stated that an actual demonstration of the "tone test" such as 
that described in the advertisement would not convince them of 
their inability to distinguish between the human voice and its 
reproduction. 

This advertisement seemed especially effective in failing to create 
belief in the minds of its readers, when over three-fourths of 
them doubted the truth of the statements. The writer recom- 
mended in this case a less extreme and less startling form of 
appeal which should not arouse the antagonism manifested in this 
experiment. 

Thus far the negative side of the question has been presented. 
If belief in an advertisement does not depend upon the truth of 
the statements made and does not depend upon the reasoning of 
the reader, on what does it depend? To state the matter simply, 
we may say that ideas which are present in the mind and are not 
interfered with by any opposing ideas will be believed. This is 
merely a bare statement of the law of suggestion and to comply 
with it in advertising, conflicting ideas should be prevented from 
entering the mind. There are many conditions on which such un- 
disturbed acceptance of ideas depends. Only three will be men- 
tioned here. 

1. The ideas aroused by an advertisement must not conflict too 
sharply with the reader's experience. Introspections volunteered 
by many of the 100 subjects who served in the experiments just 
described indicated that their past experiences with trunks, va- 
cuum bottles and phonographs furnished conflicting ideas which 
the advertisements were not sufficiently powerful to overcome. 
This was especially true in the case of the phonograph advertise- 
ment where doubt was expressed in a large percentage of the 

An experimental study of an advertising campaign that failed 
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showed clearly the need for complying with the conditions of 
belief. "Radior Products," a series of toilet preparations were 
introduced into this country by an English firm. The appeal 
contained in the advertising may be illustrated by the following 
quotation taken from one of the advertisements: "Radior is the 
magic new word in the book of beauty. It means the triumphant 
union of the finest complexion preparations with actual radium. 
Its content of radium works the miracle of nature. It purifies 
the skin, gives it the health to regain its youthfulness and loveli- 
ness." The container of these preparations was represented as 
emanating rays which were very suggestive of bolts of lightning, 
fhese toilet preparations could not be sold — the campaign had 
failed. Why? One possible reason for the failure was that the 
suggestion to apply radium on the skin for toilet purposes con- 
flicted too sharply with people's opinions about radium. In order 
to discover what people believed about radium, a questionaire was 
carefully prepared in the form of a True-False test and submitted 
to 400 people, comprising a well-to-do, well-educated group, a 
group of average intelligence and financial standing and a special 
group of person:; working in "Beauty Parlors." The questionaire 
is reproduced below. It was constructed so as to minimize the 
influence of suggestion and to correct for it when it did occur, as 
for instance in combining replies from question 2 and 7. Ques- 
tions S, 5 and 10 were introduced as fillers and had no special 
significance. 

Read the first statement on this sheet. If you feel that it is 
true, underline the word "True." If you feel that it is false, 
underline the word "False." Then judge each of the other state- 
ments as true or false. If you do not know, guess at it. This 
sample statement is false and is marked as it should be: 

There are eight days in the week True False 

1 — Radium Is a deadly poison True False 

2 — Radium is so costly that it cannot be 

used for commercial purposes True False 

3 — Treatments with radium will make 

the hair grow True False 

4 — Radium is used in the treatment of 

such diseases as cancer True False 

5 — Radium is a substance which gives off light True False 

6 — Radium when applied in diluted form gives 

a healthful stimulation to the skin True False 

^ — Radium is now used in the manufacture 

of many products in common use True False 

8 — Radium causes burns when it comes Into 

contact with the skin. True False 
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9 — Toilet preparations contsinins radium are to 

be recommended for their beneficial etTects True False 

10 — Certain forms of radium can be obtained 

at little coat True False 

11 — Radium preparations should not be used 

except on the advice of a physician True False 

12 — Radium products are saining popularity as 

mild stimulants to health tad growth True False 

Read the following question and answer it by underlining "Yes" 
or "No": 

If yon should be told that there was a toilet preparation of high 
quality and moderate price and which contained a minute quantity 
of radium, would your knowledge of the effects of radium be 
suph as to make you want to buy it? Yes No 

Nothing need be said here concerning the difference in the 
reactions of the different groups to the questionaire, except that 
the most intelligent group had the strangest reaction against 
radium-containing products, and that the "Beauty Parlor" workers 
had the least antagonism. Inquiry among these people indicated 
that some of them had confused radium with the violet ray which 
was at the time a very popular form of treatment with them. The 
results of the study of the questionaire may be summarized as 
follows : 

Forty-eight per cent of the persons tasted believed that radium 
is a deadly poison; 80 per cent believed that it causes burns when 
it comes in contact with the skin; 89 per cent believed that radium 
preparations should be used only upon the advice of a physician; 
71 per cent said that they would not buy any kind of toilet prepa- 
ration that they knew contained even a minute quantity of radium; 
90 per cent thought of radium as a substance used for the treat- 
ment of cancer. The whole experiment may be summed up in the 
statement that about 70 per cent of all the replies indicated 
opinions unfavorable to radium-containing products as toilet 
preparations. The basis of this unfavorable reaction could easily 
be traced to the people's accumulated experiences of radium. 
Clippings of all articles dealing with radium and appearing in 
newspapers and magaxines were collected for a short period. 
Practically all of them emphasised the harmful effects of radium 
and the dangers incurred in handling it, instead of any beneficial 
properties it might possess. 

This is a clear case of the inability of an advertising campaign 
to overcome the resistance established by experience. To create a 
favorable attitude toward radium-containipg products as toilet 
preparaUons by an educational campaign conducted in news- 
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papers and magazines might conceivably have been possible. But 
it certainly would have been impracticable. 

The mass of experiences Upon which beliefs rest is gradually 
accumulating and being modified by additions. As some one has 
said, "Confidence is at the same time stable and fragile." It is 
stable because of the bulk of experiences on which it rests; it is 
fragile because it is subject to change from new experiences. A 
supposed bargain which is found to be not a bargain, a derogatory 
newspaper report about a store, a misprint in the advertised price 
of an article; any one of these may be the experience that will 
introduce a conflicting idea into the mind of a consumer and upset 
the conditions favorable for his belief. The advertiser, appealing 
as he does to populations, cannot talce account of the shiftings of 
individual experience and belief, but he must take account of the 
widespread and slowly accumulating experiences which may 
amount to powerful prejudices against his appeal. 
Z , 2. Ideas that are to create belief must come from an authorita- 
tive source. This is a well-known law of suggestion. The 
hypnotist can do nothing without his air of authority and the 
subject's recognition of it. We are accustomed to believe the 
statements made by a person in whom we have confidence, and to 
believe what is printed in a medium which we consider authorita- 
tive. Even if there is conflict with one's own experience, he will 
sometimes accept the contrary experience of another person as a 
basis for belief if he have sufficient confidence in the other person. 
But even then the new experience may not be too conflicting. 
Advertisers have for years striven to develop an atmosphere of 
confidence and authority by all the devices at their command. 
The present experiment was intended to measure in a tentative 
fashion the degree of confidence which an advertisement can create 
in comparison with other forms of publication. I have compared 
the degree of belief or doubt aroused by the three advertisements 
previously described (namely Taylor Trunks, Stanley Vacuum 
Bottles and Edison Phonographs) with the belief aroused by 
essentially the same statements coming from a reputable journal. 
In order to make such a comparison, the facts stated in each 
advertisement were prepared in the form of a news item abstracted 
from an engineering magazine. One such abstract will illustrate 
the character of all. These abstracts were presented to a group 
of 100 persons of the same general character as those tested in 
the earlier experiments, but who knew nothing of those experi- 
ments or nothing of the purpose of the present experiment. Along 
with the abstract of each advertisement was a series of questions 
as nearly aa possible like those used in the test with the advertise- 
menta. Aa far as w« were able to ascertain, no one doubted the 
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authenticity of the news abstracts. Instead of reporting the re- 
sults of the three questionaires in detail, it will be sufficient to 
compare for each of the three cases the number of replies indicat- 
ing doubt in the advertisement and doubt in the news item. It 
must be remembered that the news item mentioned no trade-named 
article nor indicated any connection with specially advertised 
goods. 

The following is an extract from Magazine of June, 

1921. Read it carefi^lly and then answer the questions given be- 
low, by scratching out with a pencil the part of each that does 
■not give your opinion. 

A Remarkable Shock Resisting Cokstbuction 

"A new type of wardrobe trunk was recently put through a 
remarkable test of strength. The five-ton elephant belonging to 
the New York Hippodrome was made to stand on the empty trunk. 
An examination of the trunk following the test showed that it 
had withstood the great shock without damage. 

Interesting photographs were made of the test, showing the 
elephant mounting the trunk, seated upon it, and then stepping 
off of it." 

1 — I believe — doubt — do not believe — the statements made in the 
above extract. 

2 — I feel that the photographs that portray the test are — are 
not — genuine. 

3—1 do — do not — believe that a trunk could be made strong 
enough to successfully undergo the test described. 

Percentage of replies expressing 
doubt In the Ads In Ike Neivn Items 

Taylor Trunks 28 per cent 43 per cent 

Stanley Vacuum Bottles 27 per cent 43 per cent 

Edison Phonographs 55 per cent 40 per cent 

In two of the cases it will be noted that there was greater con- 
fidence in the advertisement than in the news clipping, while in 
the third there was greater confidence in the news clipping. An 
examination of the three advertisements did not afford an entirely 
satisfactory explanation for the shift of belief in the case of the 
third advertisement. It seems safe to conclude from these records 
that although belief in certain advertisements may be low, they 
may carry at least as much authority in presenting a set of facts 
as can be conveyed by a news article. The doubt in the cases we 
have studied is the effect rather of conflict of ideas with experi- 
ence, than the effect of the use of an unauthoritative medium of 
expression. Introspections volunteered by the subjects suggest that 
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Ulnstrations and especially photographs used in the advertise- 
ments tend to strengthen belief. Unless one suspects trickery, aa 
some of our subjects did, looking at a picture ought to carry with 
it greater weight in establishing belief than merely reading 
printed matter. Even if Mark Twain was right in advising that 
one believe only half that he sees and nothing that he hears, the 
advantage in favor of the picture is obvious. 
^- 3. There is a third important condition of belief, namely, that 
we tend to believe what arouses our desires, our fears and our 
emotions generally. I have no experimental evidence to offer in 
this connection, and know of none in the field of advertising. But 
evidence for the importance of this factor may be drawn from 
psychology. Wm. James has said, "A man who has no belief in 
ghosts by daylight will temporarily believe in them when alone at 
midnight, he feels his blood curdle at a mysterious sound or vision, 
his heart thumping and his legs impelled to flee." In strong emo- 
tion we might find the condition responsible for the belief in the 
bargain counter. The politician finds no difficulty in honestly be- 
lieving what best fits in with his aspirations, while his opponent 
may as honestly believe the opposite and for a like reason. If 
one really wants a certain suit of clothes or an automobile which 
costs more than he should pay, he may honestly believe that he 
is making an economical purchase. Once a belief has been estab- 
lished in this way, logic and reasoning may be used to support it. 
These three conditions of belief which 1 have described repre- 
sent three important variables in the formula for advertising suc- 
cess. For most advertising situations they are unknown variables 
which may interact in a very complex manner. But they may be 
discovered by careful examination. That they are not always 
sought or discovered, is clear from the cases I have cited which 
were taken from advertising already used. Three questions might 
well be asked about every advertisement: (I) What adverse be- . 
liefs and experiences does it have to meet in the minds of con- 
sumers? (2) Will the authority which it wears by its mode of 
presentation or by the medium in which it appears enable it to 
.create belief? (3) Does the appeal used arouse desires which will 
in turn create belief in the advertised article? These are human 
behavior questions that psychological methods will enable the ad- 
vertiser to answer before the advertising is used as well as after 
.the money has been spent upon broadcasting it. 
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IX. Right and Left Hand Pages in Magazines 

A considerable amount of discussion has centered around the 
question as to which is the more favorable position for advertise- 
ments in magazines, the right or left-hand page. The question 
has usually been approached through the laboratory method, sub- 
jects viewing the momentarily exposed pages of a "dummy" or a 
real magagine and then writing down all they have seen in the- 
order In which they have seen it. With this technic Adams' re- 
ports a value of the right hand page which is to that of the left as 
100 is to 65. That is, he estimates the right hand to be fifty per 
cent superior. Hotchkiss and Franken' estimate from their inves- 
tigation that the right-hand page of a magazine is worth five per 
cent more than the left-hand page. 

In order to secure additional light upon the question the writers 
approached the problem with the historical technic, seeking to dis- 
cover the frequency with which advertisers actually used the right- 
hand and left-hand pages. 

The materials used were 1082 consecutive pages of advertising 
matter in the American Magazine and 1000 in the Saturday Eve- 
ning Post, for the year 1922. Beginning with the first advertise- 
ment following solid reading matter tabulation was made of the 
successive pages containing advertising matter, exclusive of cover 
pages. Results are shown in Table I. 

TABLE L 

, I WHICH RIOUT AND LEFT-HAND 

AiKa CABB^ ADVERTISKUBNTS in the AMERICAN 

UAUAZINK AND THE SATL'BDAy BVBNINO 

POST FOR 1U22 

Total Total Total FuU Full Full 

Right Left Total Right Left ToUl 

No. % No. % No. % No. % No. 

Amer 670 66 606 44 1082 301 82 64 18 365 

S. E. P 621 62 4S1 48 1000 350 67 171 33 621 

■II. P. Adams, AdvertUlDK and lis Uental Laws, New York, MacmUlan,. 
Uie. D. 100. 

•O. B. HoHbhlH ud K. B. Frabkao, AtleDttcn Talne of AdTertliementi,. 
Nvw York, New York UDlT«nll7. mo. P- M- 
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These fl^rea show that in both magazines the right-hand page 
is used for advertisements more frequently than the left; in the 
American 56 per cent of the times and in the Saturday Evening 
Post 52 per cent of the times; with a frequency on the aver- 
age 17 per cent greater than that for the left-hand page. 

Still stronger evidence of the favor in which the right-hand page 
is held comes from facts shown in a separate tabulation which 
was made concerning the location of full page advertisements. 
There were 365 of these in the American Magazine and 521 in 
the Saturday Evening Post. Eighty-two per cent of the former 
and 67 per cent of the latter appeared on the right-hand page. In 
the first named periodical the right-hand page was used for full 
page advertisements five times as frequently as the left, and in 
the Saturday Evening Post twice as frequently. It was observed 
that certain advertisers who consistently used the same relative 
position in issue after issue almo^ invariably used the right-hand 
page. 

On the assumption of the historical method, that a practice 
much in vogue has probably proved itself profitable, it would ap- 
pear from these results that the right-hand page in magazines is 
more profitable than the left. True, the practice here revealed 
need not necessarily be considered as having been based upon 
conscious recitoning of comparative profits and losses from right 
and left-hand insertions. Even at best it probably represents only 
the fruits of a "sub-conscious" "hunch." Nevertheless it is com- 
ing to be recognized that such a process of summing up experience 
has some validity as a guide in business practice where scien- 
tifically valid measures are not yet obtainable. 

Appearance on the right or left-hand page of a magazine should, 
however, not be considered as wholly a result of the voluntary 
choice of the advertiser. Requirements of journalistic make-up 
would inevitably put some advertisements on the right and some 
on the left-hand page. Again, the requirements of color process 
or of some other technical matter might force certain advertise- 
ments on one page rather than another. Moreover, some adver- 
tisers do not specify either page, not regarding the matter as im- 
portant enough to bother with. For these reasons the more fre- 
quent use of the right-hand page can not be regarded as purely a 
reflection of profitable experience. Still these factors alone might 
be expected to work toward an equal distribution of advertisementa 
upon the right and left-hand pages. The fact that they are un- 
equally distributed indicates that some selective factor is at work 
in favor of the right-hand page. And the fact that this page ia- 
used with overwhelming frequency by the purchasers of the ex- 
pensive full page advertiseraenta indicates that the right-hand 
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pa^ haa demonstrated ita superiority to at least aome influential 
and successful advertisers. On slighter evidence than this space- 
sellers have set "preferred-position" prices. 

X. Position on Newspaper Page 

In answer to the question, what is the best portion of a news- 
paper page for an advertisement, recommendations have been 
made as follows: the upper half, the right-hand portion, upper 
left-hand corner, upper right-hand corner. Or, in recognition of 
the need for conaidertng the right and left-hand pages separately, 
the statement has been made that the upper outside corner is 
preferable.' These conclusiona have been reached chiefly from 
laboratory investigations in which the subjects have been shown 
a "dummy" or a real newspaper or magazine containing adver- 
tisements or nonsense syllables distributed among the various por- 
tions of each page, and have been asked later to write down those 
items which they have remembered. The positions bf those items 
mentioned the greatest numbers of times have been judged to be 
the most favorable. It should be noted that the conclusions re- 
garding favorability of positions are for the most part based upon 
studies made with magazines. There is considerable doubt 
whether conclusions reached regarding positions in magazines are 
true also for newspapers. 

Regardless of the advantageousress of these particular positions 
on a newspaper page it may be seen from even a cursory exami- 
nation of the best type of newspaper that they are not equally 
open to the use of advertising matter. For there is a practice of 
newspaper make-up that crowds advertisements into certain por- 
tions of the page in order to reserve certain other portions for 
news. A circumstance which presents grave obstacles to the use 
of the positions which have been so laboriously designated as ad- 
vantageous. 

Specifically described, the practice of newspaper make-up, tech- 
nically called "pyramiding," is to block up the advertisements first 
from the lower right-hand corner of the page. On some pages 
(usually the second page of the newspaper) only a small portion 
of this corner is used. But as an increasingly larger portion of 
the page (towards the middle and latter half of the paper) is 
consigned to advertisements the advertisements begin to run up- 
ward and leftward until often only a small portion of the upper 
left-hand corner is left for news. But this corner is usually thus 

•Adama. op. clt. p. 101. 
UolctikUa anil Fraoken, op 
D. Storcb. AdTerClslDB- t 
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reserved (unless the entire page is devoted to advertisements). 
Here is an apparent block to effective newspaper advertising, at 
least to that theoretically recommended by laboratory investig- 

In order to measure this block and express it in quantitative 
terms the writers undertook an investigation of actual journalistic 
practice. Choosing a newspaper that admittedly represents a high 
standard of journalistic make-up and advertising value, they tab- 
ulated the number of times the different quarters of pages were 
occupied by advertisements, and from this calculated the chances 
that an advertiser might secure a "favored" place for his adver- 
tisement. 

The New York Times was used, and 1000 successive pages bear- 
ing advertisements and news were chosen from the issue of May, 
June and July, 1922. Those pages were omitted which contained 
nothing but advertisements, also those containing classified adver- 
tisements. Notation was made in each case as to whether or not 
the particular portion (half or quarter) contained any advertis- 
ing matter, be it ever so small. Results are shown in Table I, 
and Figure I. 

TABLE I. 

"SHOWIXG THE NUMBER AND PER CENT OF LITER AND LOWER. 

RIGHT AND LEFT PORTIONS OK LEFT AND RIGHT HANT 

PAGES OCCUPIED BY " ' ' 



SOS Lett Hand Pnges 

Lower Half Upiitr Hnlf 

Lett RIsht Lett Right 

Uunrler Quarter guorler Quarter 

No. % No. % No. % No. % 

ITS 35 390 77 150 30 37U 73 

Left hand page 



4Do Right Hani: 



33:^ US 115 



Right hand page 



Fig. 1, Showing the per cent of pages on which the 
quarters were occupied by advertising matter. 
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1, Left and Right-hand Pages. 

Of the one thousand pages examined, 505 were on the left-hand 
page and 495 on the right-hand pagre. (It in interesting to note in 
this connection that full-page advertisements, which had been tab- 
ulated incidentally but not counted among the thousand shown in 
the table, appeared more frequently on the right-hand page. Of a 
total of 235 full-paue advertisements, 120 or 63 per cent were on 
the right-hand page.) 
S. Lower half. 

a. Left-hand page. On the 505 left-hand pages the lower left 
quarter was occupied by advertisements in 175 or 35 per cent of 
the cases; the lower right quarter, in 390 or 77 per cent of the 

b. Right-hand page. On the 495 right-hand pages the lower 
left quarter was occupied by advertisements in 115 or 23 per cent 
of the cases; the lower right quarter, in 335 or 68 per cent of the 

3. Upper half. 

a. Left-hand page. On the 505 left-hand pages the upper left 
quarter was occupied by advertisements in 115 or 23 per cent of 
the cases; the upper right quarter, in 295 or 60 per cent of the 
cases. 

6. Right-hand page. On the 495 right-hand pages the upper 
left quarter was occupied by advertisements in 155 or 23 per cent 
of the cases; the upper right quarter, in 295 or 60 per cent of 
the cases. 

CONCLUSIONS. 

These results show that regardless of the alleged superiority of 
certain positions in newspapers, there are pronounced limitations 
to the likelihood that these positions may be secured. Thus al- 
though the right-hand page may be more desirable, it will be open 
for advertisers no more frequently than the left, since these results 
show it to be occupied only 495 times in 1000. 

The upper outside quarter, which is recommended as being most 
valuable of all can be secured only 30 times in 100 on the left-hand 
page, though, fortunately it can be secured CO times in 100 on the 
right-hand page. (For the sake of easier visualization, the fre- 
quency with which the various quarters of left and right-hand 
pages are used is shown diagram at ically in Figure 1.) 

The right-hand side of both pages is twice and even three times 
as likely to carry advertisements as the left-hand side. Which 
means that in the case of the left-hand page the majority of ad- 
vertisements are going to be on the inside. And, unfortunately 
for the advertisers, this tendency is more marked in the case of 
the left-hand page than in the case of the right. These amounts 
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may not hold goad for all newspapers, especially for papers using 
the pyramid system more thoroughly than the New York Times. 
With such papers it is likely that the percentage of pages carrying 
advertisements in the upper left-hand corner would be still smaller. 

From a journalistic point of view this quantitative investigation 
of the practice of pyramiding shows that the pyramiding pro- 
gresses much more rapidly upward than leftward, the upper right ■ 
portion of the page being occupied almost as frequently as the 
lower right portion. Though it should be remarked that the ad- 
vertisements did not usually occupy the entire upper right quar- 
ter; tabulation was made if an advertisement merely extended 
into the area. 

While this investigation furnishes no light concerning the rela- 
tive values of the various positions on the newspaper page, it 
shows that there are distinct limitations to the ease with which 
certain positions can be secured, and it shows, at least for one 
high-grade newspaper, the size of the limitations in quantitative 
terms. It also suggests that the findings of laboratory studies re- 
garding many other problems of advertising might profitably be 
checked up with actual conditions in order to show the practica- 
bility of their application in concrete situations. 



AN EXPERIMENT IN TESTING ENGINE LATHE 
APTITUDE' 



By Everett F. Patten 
University of Wisconsin. 



The investigation reported in this paper was carried out in 
co-operution with the Shop Practice Department of the College of 
Engineering, University of Wisconsin. It was able to profit ma- 
terially by a preliminary investigation made along the same lines 
in 1921.' It was also favored by the fact that in the Shop Prac- 
tice Course there were many students turning out supposedly 
identical pieces of work on fairly similar lathes. There was an 
added advantage in the fact that the men directing the work in 
the shop were university trained, and consequently were able to 
give such aid that the preliminary psychological analysis of the 
job was made more readily than would probably be the case in 
industry. 

The particular type of work investigated was a course in ele- 
mentary lathe practice. This involved four hours of shop work 
every week and two hours of instruction every two weeks. The 
students, following a combination of oral and printed instructions 
together with blueprints, turned out five pieces on an engine lathe 
during the semester. These were : a worm, a worm-wheel blank, a 
bevel-gear blank, a spiral-gear blank, and a planer bolt. The first 
four were turned out of cast iron and the last from rod steel. 

The criterion of this investigation was the amount of skill de- 
veloped in one semester of instruction. More specifically, the 
criterion was the quality of lathe work produced by the students 
during the course. Instructors' estimates are notoriously unre- 
liable, as was found by the preliminary investigation and should 
never be used if an objective criterion can be obtained. Fortun- 
ately in this case the pieces themselves could be measured and a 
thoroughly objective criterion thus found in the accuracy with 
which these pieces correspond to the blueprint specifications. Work- 
ing with great care Mr. Brecky of the Shop Practice Department 
took thirty-three micrometer measurements on the five pieces pro- 
duced by each man measuring the various important dimensions 

'IrTi'm tliH rHycholoulcnl I.abornlor)-. VnlviTsUy of Wlwoiinlii. (ir.itctul 
nckniiwliKlKmcnt Is lu'rtliy niailt^ li> I'rnt, CLurk L. JIiill, llvp.in moiit of 
I'Hyrliiilugy, unil (a I'rof. W. 1^ Ualjnc}', iHrfctur ot Mnclilm^ ITiigticu. l-rot. 
Hull Ims BuiiiTvliwd tli> Invent (Bat Ion nnil giTon mupli lu'liifiil cril U-Ibiii. 
F»I)ecially In Hip prtrpnratlon u( llic raauuserlpt. I'rcit. Uiibiicy Iibh glvun 
in-nrty (Hi-opt'rullun iiDd li«-n ot icreat asHialiUL-c purltvulurly Jii i>rui'iiritig 
vulijLi'tH iind In iKTCi'i-tlng hoiiie ut Ibe tcslH. 

'TlilH idvusttentlUD wua rciiurled In u niuBUT'H thesis by D. \V. XHbud. It 
Ih on IHe In Uib llljrnry, fnlverelly ot Wlseonsln, 
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of these pieces. Several thousand very accurate readings were 
thus obtained. In addition the general finish of each piece was 
scored on a percentage basis. 

The measurements obtained were reduced to percentage grades. 
The deviation of each measurement from the dimension called for 
in the blueprint whs first found. A check distribution was then 
made for each of the thirty-three measurements each distribution 
containing the deviations of all the men on that measurement. The 
median of each distribution was assigned the value of 85, the 
average grade given by the Shop Practice Department. The in- 
tervals of the distribution between the median and zero deviations 
were assigned values between 85 and 100 according to the size 
of the deviation. The fourth check from the opposite end of the 
distribution was assigned the value of 70 which is hardly passing 
on the school scale. The intervals of the distribution between this 
point and the median were assigned values between 70 and 85. 
The last three checks of the distribution were given below 70 or 
failure. Thus the larger the deviation from the standard the 
smaller would be the percentage grade. The mean of the grades 
for each individual piece was found and the average of the mean 
grades of the five pieces belonging to one man was computed in 
order to get his final grade in lathe working ability. Although 
this process took weeks of work the resulting criterion was very 
reliable. Indeed the large coefficient of total correlation (R) ob- 
tained later was probably due in no small degree to the care taken 
in obtaining the criterion. 

In proceeding to find tests which would measure lathe ability it 
was first found necessary to analyze that ability as far as possible. 
This was done by watching the men at work observing particu- 
larly wherein the good ones differed from the poor ones. As a 
result of this analysis eight tests were selected. Some of these 
at first glance would seem to have little connection with lathe 
ability in general, but they were included because they were thought 
to test a constituent factor. In selecting the tests an especial effort 
was made to get tests as dissimilar as possible so that there would 
be little duplication. The detailed analysis will be given with the 
discussion of the various tests. 

(A) While studying the men at work it was noticed that the 
worker must be able to estimate two dimension space and to co- 
ordinate the motions of his two hands. He must also be quick 
and sure of movement. In order to test these abilities the "co-or- 
dination machine" was devised.' The apparatus is shown in Fig. 

'ThP nii-d tor Kiicli n iiiiK-liln'- wiis tiifi >.wii lij- Ur, Hull, who work.nl oiil 
IlK KoniTnl princ-lpli-H. Tlii' prncilinl ilfinll^ •■> conHtrui-iIca nvre ucirkt'il 
out Liy I'tof. Dolini-j-. 111? ulau cii'BlijnpiJ nnil niiide n uumber o( Imprnvpil 
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1. It may be best thought of as a compound lathe "rest" attached 




Coordination Machine. Fig. 



to a board. The action of the machine depended on two screws 
placed at right angles to each other. Turning these screws bv 
means of small cranks caused a carriage to move in any desired 
direction in a horizontal plane. A long tracer arm was fastened 
firmly to the carriage. Projecting down from the middle of the 
arm was a small brass point. This touched the surface of a hard 
rubber plate which was fastened to the board neat the main part 
of the machine. Embedded in the plate so that their tops were 
flush with the surface were six brass pegs arranged in a three- 
inch hexagon. These pegs were connected by an electric wire so 
that when the tracer point touched one of them a buzzer sounded. 
The object of the test was to start on signal from a certain point 
snd make the circuit of the six brass spots as quickly as possible. 
The time taken to go around was measured by a stop-watch. A 
correlation of this with the criterion gave a-.423. This was the 
largest and most valuable correlation obtained. 

(B) Another measure was taken of this test, that of distance 
traveled. The tracer arm extended out beyond the contact point 
and had a pencil fastened to its extremity. This traced an exact 
record of the circular path on a piece of paper inserted for the 
f urpose. A typical record is shown in Fig. 2. The distance 
traversed by this rather meandering line was measured by a 
specially devised instrument. The frame supporting the works of 
an ordinary watch was filed so as to expose the gear wheel on the 
shaft of the small second band. The hands of the watch remained 
intact. The frame was so held in the hand of the measurer thai: 
the teeth of this gear could be run around the pencil tracing, fol- 
lowing in detail all its turns. The distance traversed by this wheel 
was shown by the hands of the watch and couid be read off at a 
glance. It will be seen that the circular distance was measured in 
units of revolutions of the small hand. One minute (or one revolu- 
tion) was equal in length to 29.6 millimeters. The correlation of 
this measure with the criterion was -h.l92. This was rather sur- 
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prising since it meant that the greater the distance, the better 
the grade on shop work. However, it was included in the final 
team of tests. 




Typical Tracing from Coordination Machine. 



(C) A third score was also secured by the use of the co-ordi- 
nation apparatus described above. It was observed that the 
worker must frequently cut a true surface in a diagonal directbn 
using his eye to guide him. Accordingly the subject was required 
to run the tracer diagonally across between two of the most dis- 
tant pegs going as quickly as possible. Here, as before, the time 
was taken with a stop-watch. The correlation of this measure 
with the criterion gave -.356. This was large but since it was 
thought that it would duplicate the first measure taken, that of 
time on the circular distance, measure C was discarded. 

(D) The second measure of the diagonal co-ordination was 
made in deviations from a straight line between the two pegs. If 
a subject traced a straight line his record would coincide with 
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the diagxjnal and there would be no deviation. However, if he 
wavered and made wrong moves, his record would deviate con- 
siderably from the straight line distance and would be poor in 
proportion to the amount of deviation. This deviation was meas- 
ured by the area of surface included between the record tracing 
and the true diagonal as shown by a straight line drawn between 
the points. This was measured by means of a planimeter. The 
correlation of this measure and the criterion was -.034. This was 
so small as to be worthless. If the instructions hod been to trace 
as straight a line as possible this might easily have proven a val- 
uable test. It seems to have distinct possibilities. 

It will be noted that the co-ordination test described above is a 
form of miniature test. It attempted as is usual in such cases to 
incorporate in a single test as many of the various elements neces- 
sary for success on the job and in as nearly the right proportions, 
as possible. Being a miniature it was portable and easily handled. 
One defect of the test is that it is undoubtedly influenced by train- 
ing and thus is not a pure aptitude test. 

(E&F) Further analysis of the job showed the necessity for 
close co-ordination between hand and eye as well as for quickness 
and accuracy of movement. Accordingly the number checking test 
was introduced. This was the standard Woodworth and Wells 
number checking test in which the subject was started on signal 
and told to cross out all groups of digits containing both 4 and 7. 
He was given one minute. The correlation of the number of right 
groups checked with the criterion was -I-.055. This was too low 
to be of use so was discarded from the final team of tests. The 
number of groups wrongly checked correlated -.035 so it was also 
discarded. 

(G) It was believed that the possession of mechanical ingen- 
uity would be important for success in lathe working so an effort 
was made to test for this quality. Accordingly an adaptation of 
Stenquist's lock assembly test was used. The lock was simple and 
inexpensive. It consisted of six parts which were : a rectangular 
lower case or plate, a dog, a spring, a bolt, a screw and an upper 
plate. The subject was shown a similar lock which was already 
assembled and told to put the parts of the other lock together 
like it. Although the lock seemed very simple, many had great 
difficulty in assembling it. Four failed entirely giving up after 
working from eleven to twenty-one minutes. The correlation 
with the criterion was -.19D. Although not very high (-.33 
was obtained last year) it had such a low correlation with the 
other tests that it was kept in the final team as tapping a real 
constituent of the particular aptitude under consideration. 
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(H) The ability to follow printed directions and blueprints 
is obviously a factor in learning lathe work. To measure this 
ability and to gain knowledge of the subject's carefulness and 
painstaking traits, a box -directions test was introduced. This 
test is the well-known Healy puzzle box, conststtnK of a small 
black cabinet containing a lock mechanism worked by thre6 levers 
at tne top and left sides of the box. The object of the test is 
to open this door. The necessary steps in the process were 
printed on a large card bearing an excellent diagram of the box. 
This was before the subject as he worked. This test proved 
even more difficult than the lock test. Ten men did not open the 
box at all, some giving up with the first failure. The correlation 
of the time wil^ the criterion was -.270. This was large enough 
to warrant its use in the final team of tests. 

(I) The number of wrong moves made was another measure 
taken on this test. However, this measure undoubtedly did not 
introduce any new element because errors caused the subject to 
start over again and thus increased his time. In addition the 
correlation was low (-.112) so this measure was eliminated. 

(J) In doing good lathe work a great deal depends on the 
skill of the operator in taking accurate measurements. Accord- 
ingrly the cylinder gauging test was introduced. A series of nine 
brass cylinders was very carefully made under Prof. Dabney's 
direction. These measured .970", .9G5", .960", .940", .930", .900", 
.885", and .870". It will be seen that there were three groups 
each composed of three cylinders. Each group or aeries was grad- 
uated by a different constant the same constant being used 
throughout a single group. The finest series changed by steps 
of .006", the next by .010", and the coarsest by .015". The sub- 
ject was given a six-inch machinist's rule, and a pair of calipers 
and told to find the cylinders which measure .965" and .885" as 
quickly as possible. The time taken to find the two cylinders 
constituted one measure. This correlated -.127 with the criterion 
and was too low to be of value. 

(K) Another score on the cylinder test was the amount the 
chosen cylinder deviated in measurement from the one asked for. 
Thus if the subject chose the .930" cylinder in place of the .965" 
he was given a deviate score of .035. If he thought the .900" 
cylinder measured .885", he scored .015. The sum of these errors 
gave his deviation score, as .050. This measure correlated -.196 
with the criterion. This seemed sufficiently high to be of use but 
it was finally decided to eliminate the test from the final team 
because it was really a trades test measuring acquired skill rather 
than aptitude. 
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<L) An effort was made to teet ingenuity and reasoning ability . 
by the match-square a test, though at the ontset there seemed but 
a Efamblin? chance of success. The match-squares test consisted 
of seventeen matches glued to a board in such a way as to make 
six squares in two banks of three each. The subject was shown 
these squares then given a mimeographed sheet on which short 
lines were drawn to represent the matches in the same position 
as on the board. He was told to cross out five of the short lines 
in such a way that if they were removed there would be left 
exactly three whole squares and no lines left over. The tjme 
was taken with a stop-watch. When through, the subject was 
asked whether he had ever done this or a similar puzzle before. 
The fact that many were already familiar with it together with 
the additional fact that twenty-two out of the sixty subjects could 
not do it at all seems to have destroyed what little diagnostic value 
the test may have had: The correlation with the criterion was 
only 4-. 164. This was too small and also in the direction con- 
trary to what would have been expected so the test was discarded. 

(M) In watching the men at work it seemed probable that 
a keen sense of space relationship was necessary, particularly 
in guiding the cutting tool to its place and in finding centers. Ac- 
cordingly the circle centering test was devised. A sheet of paper 
bearing a number of mimeographed circles, (see Fig, 3) was put 
before the subject. He was given a pencil and asked to make a 
dot in the center of each circle as quickly and accurately as pos- 
sible. The task was complicated somewhat by the overlapping 
of some of the circles. The time required to place these dots was 
taken by a stop-watch and constituted one measure. This corre- 
lated -.201 with the criterion and since it was quickly and easily 
taken. Since the test was so cheap and portable it was kept 
in the final team of tests. 

(N) Another measure was taken from this test the errors in 
locating the centers. These deviations from the true centers 
were measured translated into grades by a rather complicated 
process and these grades averaged to get the final grade for each 
man. Since this measure was not used the process will not be 
discussed further. The correlation with the criterion was fairly 
high (-.273) but was in a direction contrary to what was ex- 
pected. Apparently the good subjects sacrificed accuracy to speed. 
Partly because of this, and partly because of the labor in scoring, 
this test was not included in the final team. 

(0) It seemed reasonable to believe that if a man were skillful 
in handling woodworking tools he would also tend to be an adept 
in using other kinds, such as are employed in lathe work. Fol- 
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Fig. 3. Circle Centering Test. 
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lowing this line of reasoning the woodworking test' was given. 
The subject was asked to saw a three-inch square from a small 
board of definite size and shape, being given a saw, a square, a 
pencil and a special device for holding the wood such as is in 
common use in manual training shops. He wtis timed by m^ans 
of a stop-watch. This measure had the surprisingly low correla- 
tion of -.119 with the criterion. It was discarded. 

(P&Q) Two other measures were taken from the woodwork- 
ing test one in deviation in dimensions from the tiiree-inch square 
and the other in deviations from the true right angles. These 
latter measures were very difficult to make, requiring hours of 
almost microscopic work with a vernier rule, a square and a 
rule calibrated to one hundredths inch. The correlations in both 
cases were low, being -.095 and -I-.076 respectively. Both meas- 
ures were discarded. It was a source of some surprise that the 
woodworking test did not have more diagnostic value. 

The instructions for each test were given according to nn un- 
varying formula so that the results would be as comparable as 
possible. The testa were given in a quiet room in a definite se- 
quence. When the subject was admitted he went in regular suc- 
cession from one test to the next, showing a card containing his 
name and number to each tester. By such devices a constant 
stream of subjects was kept flowing smoothly through the testing 
room. In order to obtain useful results, it was thought desirabJe 
to use a minimum of sixty records. Consequently over seventy 
men were tested so as to allow for the loss of ten through de- 
fective records from various causes. 

A summary table of the correlations already given is as fol- 
lows: 



■<A) Criterion with co-ordination test, time -.423 

•(B) Criterion with co-ordination test, distance -H.102 

(C) Criterion with co-ordination test, diagonal time ~.S5G 

(D) Criterion with co-ordination test, diagonal deviation -.034 

(E) Criterion with number checking, rights -f-.055 

(F) Criterion with number checkig, wrongs -.035 
•(G) Criterion with lock test, time -.199 
"(H) Criterion with box test, time -.270 

( I) Criterion with box test, errors -.112 

( J) Criterion with cylinder gauging, time -.127 

(K) Criterion with cylinder gauging, deviations -.196 

■Tbe nooJwarklnK tvBt wan dvvlHL'U by Mr. F. <'. .Mueller ot tbe 
I'aycUoluK}' Ui-purtmeDl. L'uiverHlty of WUcudh.d, 



TESTING ENGINE LATHE APTITUDE i 

TABLE I— cont. 

(L) Criterion with tnat^h square, time +.16 

*(M) Criterion with circle centering, time -.20 

(N) Criterion with circle centering, grades --27 

(0) Criterion with woodworking, time -.11 

(P) Criterion with woodworking, deviations in dimensions -.09 

(Q) Criterion with woodworking, deviations in angles +.07 

The variables finally used were renumbered for convenience; 

Criterion =1 

Co-ordination, distance =2 

Co-ordination, time -"^ 

Lock test, time =4 

Box test, time ^=5 

Circle centering, time — C 

The means and standard deviations of these variables are show 

in Table II. 

TABLE II. 



Means. 


Standard Deviations. Unit of Meapiircmenl. 


M,^4.046 


S.D.,^3.689 


Percentage grade on work pieces 


M^ 6.9406 


S.D.^ .2653 


Minutes-distance"* 


M^ .9256 


S.D.^ .3869 


Minutes 


M,^ 5.8585 


S.D..^5.089 


Minutes 


M^ 4.78 


S.D..^-2.627 


Minutes 


M.= .3765 


S.D*-= .2547 


Minutes 


The zero 


order correlations 


and intercorrelations are shown in 


Table IIL 








TABLE IIL 


r,i=+.192 






r„^ -.423 


r=^ -.229 




r,.= -.199 


r„=^+.142 r>,== 


+ .056 



r„- -.270 r»=+.118 r..^+.036 r..=+.103 
r.^ -.201 r«^+.022 

The P. FJ. of each of the < 
roughly .08. 

It will be noted that although the correlations with the criterion 
are fairly high, the intercorrelations are exceptionally low. More 
than usual stress was laid on the latter in this investigation be- 
cause it was thought that this principle is generally observed too 
little. To get the undiluted correlations with the influence of the 
■Other tests removed, the zero order correlations were subjected to 

•Imlicntee the lexte wtilch w^rp liicluileil In lb* llnal tenm. Tlie oliovi- r'g 



partial correlation, using Yule'a formula' and Rosanow'a' genera? 
technique. 



V 'i V -4 



ime fifty-two of these parttals. Only those of* 
3 given in Table IV: 

TABLE IV 

Partial correlations 



l.~>.334lj= ^3sa 
in.2S4G= _ioo 
These partial correlations show but very little shrinkage and 
show that th« experiment was unusually successful securing a set 
of testa highly uncorrected with each other. 

After the partial correlations were found, the coefficient of total 
correlation was computed. This correlation of the criterion with 
all the tests weighted in the best possible manner, was computed 
in two ways to check the arithmetic' The formulae were 





2 
U.2U 


''n.is«s 



One correlation was .6549 and the other .6545 showing all the- 
partials to be correct. This correlation ia about as large as seems 
possible to secure from such highly selected groups as university 
students. It demonstrates the possibility of detecting aptitude in 
quality of lathe work produced, 

In order to get the maximum yield from a team of tests as 
well as to use a set of test scores to predict probable success in 
a given vocation, a regression equation must be obtained. The 



'Vule. 



knalj'Hi 



u Ihc TLi'o 
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general form' for this equation for six variables (criterion and 
five tests) is: 



1= U.SiM 2+ 1I.Z4S6 

SD sr 



1S.2MS « 

SD 

Where x,= the deviation of any subject from the mean of that 
variable (here the criterion), where x,, x,, x,, x„ and x« equal the 
deviation of any subject from the means of the respective varia- 
bles, and where S.D. i.whi etc., equal the partial standard devia- 
tions. These partial standard deviations are obtained by a formula 
of the type;' 

S.D. -3.D. / i — ~ 

tG.2St 18.2346 

The partial standard deviations are shown in Tabie V: 
TABLE V. 
S.D.,.«»=3.070 S.D.^,b:.=4.881 

S.D.,.«„= .248 S.D.i..m.=2.483 

8.0.,.™.= .343 S.D...,«= .247 

Substituting these, together with the partial correlation coeffi- 
cient, in the formula for the regression equation and solving we 

x,=2.397x^3.252x.-.132xr-.353x.-1.996x. 

This, however, is not a very convenient form of the regression 
equation for practical use. Substitutions were accordingly made- 



for the small x'a so that instead of deviations from means were 
had individual scores minus the mean of that variable 
(Xi.-M= . The formula then becomes: 

Xi-M,=2.397{X^M.)-3.252(X,-M,)-.132(X,-M,)-.353(X,-M0 
' .1.996 (X^M.) 

Substituting values for the various means (found in Table III) 
and solving, the following equation was secured : 

X, =73.635 +2.397X,-3.252X.-.132X.-.353X.-1.997X. 

It wiil be noted that the values Xi to X< represent gross scores 
o£ any given subject on the present team of tests while Xi repre- 
sents his probable grade in a course such as previously described. 
Now if a person of unknown aptitude in this kind of work should 
be given the above tests, his test scores might be substituted in 
the alwve equation and his most probable grade in such a course 
t>e predicted with some precision. To take an actual case, subject 
number 9 made in this team of tests, the following scores: 

Co-ordination, distance=6.6 revolutions 

Co-ordination, time^^l.05 minutes 

Lock test:=1.17 minutes 

Box test=3.37 minutes 

Circle centering, time=.3j minutes 

Substituting these in the equation, the result is : 

X,=73.635^2.397(6.6)-3.252(1.C5)-.132(1.17)-1.996(.35) 
Solving, X,=84.008. This man actually scored 84 in his five 

To lighten the work of prediction, both for this investigation 
and for the one to be carried on with a new group of subjects 
here next semester, a chart was prepared containing all the 
products of the probable test scores and their respective weights. 
1 Le scores were then predicted for all the sixty subjects, both to 
confirm the R and to observe the detailed relation of individual 
predicted scores to the actual scores. This is shown in detail in 
the scatter diagram, Fig. 4. 
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FIGURE 4. 
Scatter Diagram. 
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KACIAL DIFFERENCES AS MEASURED BY THE 
DOWNEY WILL-TEMPERAMENT TEST 

By John H. McFaoD£N and J. F. Dashizll 

INTRODUCTION 

Study of character and personality traits is, by its very nature, 

a perplexing problem, since there are a multiplicity of factors 
entering into the make-up of any g'iven individual, and since the 
organization of theae factors varies so greatly vvith each individual. 
Several tentative classifications of the traits and of the factors 
governing the combinations of the traits have been made. Wood- 
worth' analyzes personality into four factors: Physique, Chemique 
or Temperament, Instincts, and Intelligence. F. H. and G. W. 
Allport" divide tendencies into: Inteliigence; Temperament, includ- 
ing Emotional Breadth and Emotional Strength; Self -expansion, 
including Extro-Intro version, Ascendance-Submission, Expansion- 
Reclusion, Compensation, and Insight and Self- Evaluation; and 
Sociality, including Social Participation, Self-aeeking and 
Aggressive Self-seeking, and Susceptibility to Social Stimuli. 
Tests for these were given, and the results checked by estimates 
of character and personality given by friends of the subjects 
tested. The above division of tendencies is considered by the 
writers as merely a tentative one which may be of some use in 
{guiding further character analysis. Watson' gives a form for 
analysis of personality, and Wells' classifies the healthy mental 
reactions as distinguished from unhealthy ones. H. T. Moore and 
A. R. Gilliland* studied aggressiveness as a personality trait, iso- 
lating it as far as possible by selecting two groups of students, one 
composed of students rated as the most aggressive in their class, 
and the other composed of students rated as the least aggressive 
in their class. The foliowing tests are suggested as measurements 
of aggressiveness: eye movements; distraction from staring, from 
electrical shock, and from visual presentation of a snake; and a 
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word aaaociation teat. In the above tests, the first ^oup scored 
bigb, and the second ^oup scored less, thus indicating the value 
■of the methods used. R. O, Filter' studied Self-Assurancs and 
£peed of Decision, concluding that one test was not sufficient for 
■each trait, but that two or more should be given. Also, he con- 
cludes that there was not a very close correlation between speed 
of decision and self-assu ranee. The test used in the present 
study of racial differences is the Downey Will-Temperamsnt Test' 
formulated by Dr. J. E. Downey, of the University of Wyominj. 

The particular problem here studied is the comparison of tem- 
perament as found in individuals of the white and negro races. 
Previous studies have been made regarding the comparative in- 
telligence of the two races. Mayo' finds that, while the "data 
points clearly to a measurable degree of mental difference," the 
differences are of degree, and not of Icind, and that mental varia- 
bility is sl'ghtly less in negro high school students than in white 
high school students. Ferguson*, using the Woodworth and Wells 
Mixed Relations Tests I and II, a form of the Ebbin^rhaus Coiti- 
pleticn Test, a Cancellation Test, and one of the Columbia Maze 
Tests, finds the intellectual performance of the genara! colored 
population to be approximately seventy-five per cent as efficient 
as that of whites, with the possibility of negroes more nearly 
approaching whites in reasoning based upon concrete objects than 
in reasoning based upon mental representations of the objects. 
He finds a practical equality in sense capacity in the perceptive 
and discriminative abilities, and, since the difference must exist in 
the central elaborative powers upon which thought more directly 
<Iepends, he infers that such neural differences as may be found 
will probably be mainly in the constitution of the cortical neurons, 
rather than elsewhere in the nervous system. This point will be 
taken up later. Ferguson also states that, while no certain con- 
-clualon as to racial variability can be reached, it would be reasan- 
able to suppose that the negroes would vary more than whites, 
since the so-called negro race is not nearly as homogeneous as the 
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white race. Derrick'" finds that the negro college student is older 
than the white, that their average intelligence quotient is nine 
points lower than the average white intelligence quotient, and that 
the white college student is about seventy-seven per cent aa vari- 
able as the negro college student. 

Turning from previous work on intelligence, and considering 
other studies of racial differences, we find several reports on dif- 
ferent traits. Stetson" finds practically no diiTerence in memory 
in the two races, though there may be some doubt as to the value 
of this contribution. Bache'-' finds the negro quicker in his reac- 
tion time than the white man, and Garth'' finds that there are 
slight differences in their work curves — that there is a tendency 
of the negros to do more of their work in the first half of the 
allotted time than for the white workers. This would indicate 
that the negroes are more quickly aroused to work, but that, after 
the first spurt, their effort diminishes, Mitchell, Rosanoff and 
Rosanoff" in a study of association, find that negro children, on 
the whole, show further departure than white ones from the normal 
adult association standard. 

Before going- on into our particular problem, it is necessary to 
note some cautions which experimental work has given. Pressey"" 
warns that grade norms may vary very greatly in various schools, 
that there may be different age distribution, and that other factors 
may enter in. And, in a comparison of students of different races, 
it is all the more important to bear this in mind, since grade n^rms 
will inevitably vary much more greatly in schools for different 
races than in different schools for students of the same race. 
Arlitt" finds a tendency for greater variation (in results from 
intelligence tests) in the same race but different social status than 
in the same social status but in different races. This latter point 
will be considered in the next section. Further, as Gatewood" 
points out, there is a tendency to rate negro children above their 
mental status, as compared with the tendency to rate whites at or 
below their true mental status. 
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SUBJECTS AND TESTS 



The subjects tested were white and negro high school and college 
BtudentB, It was hoped, by choosing such groups, to eliminate 
many of the factors of selection, and to make the groups more 
directly comparable, and also to fix a general level of intelligence 
between the groups. It was found, however, that, in general, 
negro students of each grade were slightly older than white stu- 
dents of the same grade. This is constantly found in comparisons 
of white and negro students. Graphs and tables follow, which 
endeavor to analyze the general results, and to interpret them in 
terms of equal ages and equal grades. These results are based 
upon the records of 38 high school and 39 college students from 

The thirty-eight white high school students were tested at the 
Chapel Hill High School, and were chosen at random, nearly all 
of the male students being taken. A note should be made here 
concerning the make-up of this high school, since it is a little out 
of the ordinary. The high school students are dtawn from three 
fairly distinct social classes: those from the surrounding farm 
and mill districts, those whose parents are in business in the town 
of Chapel Hill, and those whose parents are members of the 
Faculty of the University of North Carolina. A survey of gen- 
eral intelligence of these students with regard to their respective 
social classes was made in 1917 by Chase and Carpenter and again 
in 1921 by Dashiell and Glenn, who found that the social levels 
and intelligence levels were strongly related. As might be ex- 
pected, the Faculty children led in general intelligence, followed 
by the Town children, with the Out-of-Towr group last. Chapel 
Hill High School embraces the 8th, 9th, 10th, and 11th grades, 
with seven years of grammar school work preparatory. 

The thirty-nine white college students were taken from classes 
in psychology at the University, the entire class in Abnormal 
Psychology being tested, and the balance volunteering from intro- 
ductory classes. Except for the very few freshmen and seniors, it 
is a fairly typical group of college students. 

For the negro subjects, students in three negro institutions were 
tested. The National Training School, at Durham, N. C., fur- 
nished five college students and all except two of the high school 
students. There is some doubt as to the validity of all the results 
from this group, since the testing was stopped, after forty sub- 
jects had been secured, upon evidence that some of the students 
were being coached by their fellows. This would naturally affect 
the Reaction to Contradiction test, and it seemed to affect the 
Motor Inhibition and Co-ordination of Impulses tests, since there 
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WB3 an unnatural tendency for the subjects t^i write excessively 
slowly in the preliminary warming-up (Test II, 3), and, for th« 
Co-ordination of Impulses, to take great pains in adhering to the 
space limitations, but to fail in the time limitations. These 
tendencies were not noted with other groups, either of negroes or 
of whites. The doubt concerning coaching, and the fact that these 
tests and the norma for grading them were developed primarily 
for adults, would render the high school comparisons somewhat 
inconclusive, and would emphasize the results from the college 
^oups. 

The second group of negro students was from Shaw Univei^ity, 
in Raleigh, N, C. The men tested were selected by the President 
of that University. Shaw University is one of the best negro insti- 
tutions in the South in regard to college ranking- Eighteen men 
were tested there, during a period of three days. The wi'iter does 
not believe that any of the men in this group were coached. 

The last group of negro students was from the Negro Agri- 
cultural and Technical School, at Greensboro, N. C. This is a 
state institution, but, owing to the fuct that agricultural schools 
usually have lower standards of admission than the Colleges of 
Liberal Arts in the various Universities, it is possible that a 
comparison of the men in this group with men from the Univer- 
sity would be unfair. Still, the three negro schools visited are 
typical of the institutions of that race, and the men afford a 
better basis of comparison, being more widely distributed, than 
if nil the subjects were taken from one institution. At the 
Agricultural and Technical School, eighteen men were tested dur- 
ing a period of throe days, sixteen of the men being of college 
grade, and two of high school grade. 

Although precautions were taken to standardize the subjects 
in regard to education, it must be admitted that the criticism of 
Arlitt'' regarding dilferences in social status holds good here. 
Derrick" reports that "White boys from average environment go 
to college nearly twice as frequently as negro boys from average 
negro environment"; thus, the negro college students are more 
highly selected from their environment than the white students from 
theirs. The group of nesro agricultural college students furnished 
a partial check on this condition, but for the best study in race 
comparison, it would be necessary to select a large number of in- 
dividuals from all environ mentis. The present comiiarison can 
claim to hold good only for college and high school students of the 
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To better insure uniformity in results, all of the tests here 
reported were given by one of the writers and were graded by him. 
The grades were checked by the same writer and by a student 
trained in the method of grading. 

It is not thought necessary to give an exhaustive description 
of the Will-Temperument Test, but definitions of the traits scored, 
and a statement of the value of the scores in each, are necessary 
for a full understanding of the results. In the order in which 
they are listed by Prof. Downey™, they are: 

Speed of Movement : Speed of movement of person relative to 
size and age. A score of "10" here indicates a very high speed, 
grading down to "1", which indicates very slow movement. 

Freedom from Load or hiertia: Tendency to work at one's 
highest speed without external pressure, little tendency to relax 
speed, quickness in warming up to a task. A score of "10" indi- 
cates practically uniform speed, "1" indicates great increase, which 
may mean that the subject usually works more slowly than he 
could — that he has excessive "load" or weight of inertia, 

FIcxibiliti/: Ease and success in readjustment; capacity to 
modify one's routine reactions, A score of "10" here indicates 
highest success, "1," practically failure. 

Speed of Decigion: Quickness in reaching a decision or con- 
clusion. A slow reaction here may be due to caution or con- 
servatism in weighing the elements involved in a situation, or be 
caused by one's being side-tracked by irrelevant matters or a 
rambling procedure. Here "10" indicates a speedy decision, "1", a 
very slow decision. 

Motor Impulnion: This trait refers both to impetuosity and 
energy of reaction. Consider the ease with which the brakes or 
inhibitions can be removed, and ali^o the tendency to explosive re- 
action when the brakes are actually off. A "10" here indicates 
explosive or expansive reaction under distraction, grading down 
to a "1," which indicates inhibition or withdrawal into one's self. 

Reactwn to Contradiction: This refers to the degree of con- 
fidence with which one maintains his opinion against contradic- 
tion. A "!)" or "10" reaction signifies an aggressive subject — the 
burden of proof is thrown on the person who does the contradict- 
ing; "7" and "8" are confident reactions, but reasons arc cited for 
one's confidence and the burden of proof is accepted : "5" and "6" 
are tactful reactions; below "5" there is n grading down to com- 
plete failure to assert one's own opinion. 

Reaiatanee to OpiHmition; The vigor with which one reacts im- 
mediately to a blocking of one's purpose. It grades from "10", a 

" Iiuwn.'j-. J, K. llnnrin/ of Uin-rii;,,, f;r Twdnv. World Bonk Co., 
UuilKoii. N. v., IV^i. 



S6 McFADDEN— DASHIELL 

strenuous reaction, to "1", complete passivity in the face of 
opposition. 

Fitiality of Judgment: Confidence in previous decision, willing- 
ness or unwillingness to reopen a question once closed. A "10" 
indicates refusal to reconsider, or a very rapid reconsideration, a 
"1" indicates extremely slow reconsideration. Sometimes the sub- 
ject spends as much time on review as he does on the original 
decision. The score in this trait should be interpreted while bear- 
ing in mind the score or time spent on the original decision. 

Motor Inhibition: Capacity to keep in mind a set purpose and 
achieve it ulnwly. It involves power of motor control, imperturba- 
bility, and patience. A score "10" indicates highest success, a 
"1" indicates practically no inhibition. 

JvtercKt 111 Detail: Attention to details. This trait is not equiv- 
alent to accuracy, but rather it indicates thoroughness, which may 
or may not be accompanied by analytical thought or insight. 
A "10" indicates highest care for details, a "1" shows very 
little care. 

Ca-ai-diiitilioii of Imiiiihex: Capacity to execute a double task 
without preliminary trial, capacity to handle a complex situation 
successfully without forgetting either factor involved. This trait 
is probably allied to keeping one's head in a confusing situation. 
A "10" here indicates greatest success, a "1" indicates practically 

VoUtiotial Pcrsererntion: Absorption in a task; willingness 
to keep "plugging away" at it because the examinee sets up a 
goal for himself. A "10" here is also the most desirable score, 
while a "1" indicates little desire to take pains in perfecting a 
piece of work that the individual takes personal pride in. 

The scores in the Downey tests were obtained by taking the 
records of a large number of individuals, for some given trait, 
and assigning score values in such a way that 10 per cent of 
the persons tested attained each score. Thus, in a given group, 
we could hardly expect to find normal distribution curves for the 
various traits, but rather a tendency for an equal number to 
attain each score. Further, the total score made on the test is 
not as significant as the grouping of the scores in the various 
traits, although it has been considered that a high total score 
indicates a "strong" personality, and a iow total score indicates 
a "weak" personality. Also, the tests ami grading norms were 
devised for adults, and this should be taken into consideration 
when these tests are given to younger subjects. 

G. M. Rush" gives a criticism of the Will -Temperament 

=" Itush. li. JL .1 IVrfluiiNOfH Statin uf the t':,;rl-iiuiut ~H^lurfii 
KiillmHt-- uf I MtHI'<nu) T'liiU anil tht Hi-huIIv {<—« the l'-,rai>i ■■»lll-fn.flle." 
Jiiumul uf A|>|.]1>'(1 1-KyvlioluKr. V..1. 5. Nu. :;. .lur.'. IHL'I. 
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Test, in rctrard to correlation of the results and estimates. He 
finds, for fifteen subjects, very little correlation between the 
estimates of the trnits and the scores in tho.ie traits as tested 
by the Will-Temperament Test. Prof. Downey", however, 
using a slightly different method of estimates, found sufficient 
correlation to justify the tests, 

RESULTS AND INTERPRETATIONS 

Table I contains the summary of means and medians of the 

scores in the vnrious traits for the two races, divided into college, 

high school, nnd combined groujis, with the standard deviation 

from the mean in the various traits for the two college groups. 

TABLE I. 

Colltge Students High School Combined 

wurri'; sTi iii:.\Ts 

Tnitl Mi'an S. li. .M.nlhiii .\[>-iiii Mi-ilhin .M'.-un Mi"l1un 

Speed of Movement (1.77 2.r)31 7 4.13 3 5.4iJ 5 

Freedom from Load 5.-11 2.r>:i7 

Flexibility 5.1,5 1.740 

Speed of Deci.«ion 4.1(1 2.8H8 

Motor Impulsion 4.r)l 1.7K1 5 3.7« 4 

Reaction to Contradiction 5.7U 2.4ril 7 5.50 6 

Resistance to Opposition 5.77 2.731 7 5.5(J 7 

Finality of Judjimunt 4.'J2 ■i.-.Wl 5 Ti.W 5 

Motor Inhibition 5.11 3.4119 6 4.(>0 5 

Interest in Detail T.33 1.4R!) 7 fi.44 

Co-ordination of 

ImpuLses r,.02 2.88:2 7 n.(1!> 2. 

Volitional Perscvorution..(J.(i4 S.ll.'ifi 8 .'i.Sl 
nk<:ri> stiuknts 

TniH .M-:iu S. IV .Miiliaii i\-:ii\ »ri\ 

Speed of Movement 4.10 3.117" 3 3.UH 2 

Fruedom from Load 5.-J8 2.716 5 5.87 5 

Flexibility 4.00 2.00(1 4 4.2:! 4 

Speed of Decision :f.87 3.01H 2 4.71 4 

Motor Impulsion 5.15 l.:i.".G 5 5.47 5 

Reaction to ronliadiction G.IO l.l)!i7 7 0.81 7 

Resistance to Op posit ion.. 5.33 2.(i41 5 ■'i.0~> 5 

Finality of Judi^ment 4.77 2.:!iil ."> C.21i 7 

Motor Inhibition :!.S4 3.51!) 3 6.7fi 8 

Interest in Detail 6.82 2.1.1(.! 7 n..=i2 7 

C^-ordination of 

Impulses :1.87 2.838 ;t 2.13 1 

Volitional Ptrseverati..n...5.(!;( 2.524 5.80 7 
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Attention must he called to the fact that a composite profile 
plotted from mean or median scores, as given in Figure 1 and 



FIGURE 1. Mean Scores. 
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sibility of individual variability in the scores 



ther 



: than in a vt^ry general way. 
However, from Table I, and 
, general that the "average" 

)vement, that he has slightly 
, he tends to work on the 



J profiles do not indicate, r 

tendencies toward racial patterns. 

Fignit-cs I and 2, we may say i 

white student has greater speed of n 
greater freedom from load — that : 
weighing of the evidence, or less decisiveness; that he is slightly 
average more nearly at his greatest speed; that he has slightly 
greater flexibility and ability to meet new conditions in life; that he 
is slightly slower in making decisions — which may mean a better 
less liable to become explosive under distraction from conflicting 
stimuli; that he is less forceful when contradicted, which may mean 
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a greater degree of social adjustment (a score of "5" is the tact- 
ful reaponse), or a greater dei?ree of suggestibility; that he ia 
firmer when confronted by obstacles or physical opposition; that 
he takes about the same time, or slightly longer in reconsidering 

FIGURIC 2. Me<Uan Scores. 




his decisions, which may be due to ereater care, or to greater 
indecision; that he has, as u college student, greater ability or 
desire to restrain his impulses, and, as a high school student, less 
ability or desire (but here must be remembered the criticism given 
above, that there was some evidence of coaching upon the results 
from negro high school students) ; that he has practically the same 
interest in detail; that he has u markedly greater ability to co- 
ordinate his impulses, or to meet confusing situation; that he 
has a slightly greatur tendency to volitional perseveration. 

Figure 3 shows the distribution of the individual scores in each 
trait, for the high school students, the college students, and the 
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combined groups, (.f both riices. Score viklueii are indicated on 
the horJKontul axis, nunibor of individuals on the vertical. 

The median profile of the high school students (Figure 2b) 
shows eraiihuMia on the trnits which combine to suRBfst an a;rjrres- 
siip-e perimnality, a result which was found by Ur. Downey"^ 
in testinp: hif;h school frcshmon. 

A point may here be brought out in relation to the nepro's 
tendency to resist contradiction more strongly than the white. 
Dr. Bevis-', tabulatins the frequencies of vaiious forms of 
psychoses among the Southern nejiroes, reports that dementia 
praecux stands at the head of the list of their psychoses, with the 
catatonic form occurring uljout twice as often as in the white. 
Since ont of the choracteristic symptoms of the cntntonic f:)rm 
of dementia prenciix is neRativism. thp re.^ult of this test checks 
fairly with Dr. Bcvis' report. Also, (and cf. Xo. H in "Summary") 
we mifiht iixpi-et a Rreatcr degree of afifn't'ssivuness from the 
netrro whun he is allowfd to reveal his inner self. As a race, 
they art Ririierally oppressed or held down, u fact which mij^ht 
load us to look for u n-actinn in the diruttion to (rrcater aRffes- 
sivene.s,; when unchecki'd. Obs^orvntions of Northern neRroes have 
been repurted, whiU'e the nepro, freed from race restraints, has 
swung to the other extreme and lias \h-ch rather too a;ri»rcssive ; 
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the relative variability of whites and negroef, thnt it would not 
be at all surprising if group.i of so-called negroes wei-e definitely 
shown to be more variable than comjiaralile groups of whites. For 
the groups that are generally called OL-groes are comiio.«ed of in- 
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FIGURE 3. 
Distribution of Indiviilual Scores in the Different Traits. 
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dividuals ranRing from pure negroes to persons almost white, 
and it would be reasonable to suppose that such (froups would 
v-ftry more than would homogeneous white groups." Mayo-' states 
that mental variability is less in negro hiffh school students than 
in white high school students, thu ratio being 93 to 100, Derrick" 

TABLE 11, 

Comparison of the StnnHard noviiitions of the Scores Made by the 
White and Negro Collocre Students in the Various Traits 

While N'oRro White Per Negro Per 
Trait S, I). S. D. Excess Cent Excess Cent 

Speed of Movement i.'m a.070 .bS9 21.3 

Freedom from Load 2.."i;i7 2.7HJ .17!) 7.0 

Flexihiliiy 1.74(1 2.0011 .2B0 14.9 

Speed of Decision 2.ti8S 3.n4.'i .157 5.4 

Motor Impulsion 1.7S1 l.!i.=ir. .174 9.7 

Reaction to Conirudit-tion 2.4fll I.1»1I7 .454 L'2.2 

Resistance to Opposition 2.7:!1 2.(i41 .OHO :l.4 

Finality of .Iudj,^mcnt 2.:lll2 2.;i01 .OlH 3.8 

MoUir lEihibition ;!.4IH) HM'J .110 3.2 

Intt^rest in Detail l.lSf) 2.1Jfi Mu 44.1 

Co-ordinntion of Impulses 2.8S2 2.s:!K .ii.|4 1..7 

Volitional I'erwveratic.n -'.Wr, 2..'.24 .441 IR.2 

Avei'a^' Per Centage 
of Kscess 9,8 l.i.l 

I'ni'is the o]i[>OKite in i-efiaril to collejio students, when compared 
ill respect to inU'llisenct'. He says "The whiti' collejre student was 
about 77 per cent as variable us the negro. " Xor is anything 
definite concerning variability fonnil in the re.=ults from the Will- 
Temperamont Touts. Iiisiwction of the distribution curves for 
the scorRM in the various tests (Fifruro 3) ."hows practically no 
Iirepondirunce of cither race, Comiiarison of the standard devia- 
tions from the mean in the stores made by college students. 
Table II, shows that the negro deviations exceid those of the 
whites in seven of the traits, and that the amount <if exce.ss is 
relatively grcatt-r. Thi-re would, then, -com to be a slight but 
not .striking tendency fi;r the nogm to be more variable. 

After the comparisons given iiho\i; were made, the rpsults were 
analyzed in terms oi' afjes and iicadt-mic grades. Kxeept for the 
preponderance of fri'shmen in the white high school group, and 
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Distribution of subjects by agM And grix^t^s- 
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TABLE IV. 



'> 



Mean scores by afres of subjects. 
wiiiTK H'rriuiNTS 
SlI FL F SD Imp. RC RO FJ Inh. ID CI VP 
3.81 B.38 -1.24 3.38 3.'.t0 5.81 4.81 5.66 5.76 6.76 4.38 C.28 
6.05 6.07 4.83 4.20 4.79 5.00 6.14 5.38 5.24 7.14 5.20 G.07 
5.43 5.82 4.78 3.48 3.69 6.91 5.69 4.78 4.17 6.82 4.56 6.52 
5.75 5.75 5.50 2.25 3.25 7.50 6.00 5.00 3.75 6.25 5.75 5.50 

NKIJRm STI'IjENTS 

SM PL F SD Imp. KC RO FJ Inh. ID CI VP 

2.60 3.40 4.20 4.80 5.40 6.00 5.40 7.00 7.20 6.80 2.00 C.OO 

2.35 5.74 3.87 4.65 5.49 6.69 5.17 6.09 5.26 5.65 2.09 6.22 

5.15 6.30 4.10 5.00 4.85 6.10 5.00 5.95 4.50 6.95 4.00 5.40 

3.62 5.58 4.31 3.2J 5.55 6.48 5.31 4.55 5.52 5.34 2.76 5.79 
For number uf subjects in eucb group, and (^radea represented, 
sec Tuhle 3. 

Figure IV. 
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of sophomores in the white college KToi^Pi the distribution of stu- 
dents is approximately the same in both races. Table III shows the 
distribution by age and grades. From inspection of this table, 
it is seen at once that the negro student is from two to three 
years older than the white student of the same grade. This 
retardation may be caused by adverse environment or by inferior 
intelligence of the negro. Probably both factors are at work. To 
eliminate as much as possible the influence of age on the scores 
made by the groups, the subjects were divided into four sections, 
the first section containing those IC years of ago and younger, 
the second section containing those from 17 through 19, the third 
those from 20 through 22. and the fourth those 23 and above. 
Table IV gives the mean scores made by each section in each 
trait and Figure 4 shows the profiles plotted from these data. It 
will be seen from inspection that, a.i the subjects grow older, there 
is a tendency for increased scores in speed of movement, flexi- 
bility, reaction to contradiction, and co-ordination of impulses; a 
tendency for decreased scores in speed of decision, finality of 
judgment, motor inhibition, and perhaps volitional persevera- 
tion; the scores for motor impulsion tend to remain about the 
same; in freedom from load, the white scores remain about the 
same, or decrease slightly, while the negro scores increase with 
age; in resistance to opposition, the white scores increase, and the 
negro scores remain about the same; in interest in detail, the 
white scores decrease slightly, while the negro scores vary. The 
increase in speed of movement may be due to increased use of writ- 
ing, the necessity for rapid note-taking, or the influence of other 
situations in every-day school life that call for speed in writing. 
The increase in the three other traits noted would probably be due 
to a deeper realization of problems as such, and the consequent 
tendency to eliminate "snap judgments". The decrease in motor 
inhibition and volitional perseveration may be due to the greater 
value which the older person puts upon time, or, in the case of 
motor inhibition, the decrease of content which the test-phrase 
holds for him, and the consequent increase in difficulty of the 
test. A person's rating in motor impulsion is probably a 
fundamental part of his make-up, and would hardly t>e expected 
to change in either direction. A true race difference may be 
indicated by the difference in the change of scores for freedom 
from load, in which those for the whites remained nearly constant, 
and those for the negroes increaswi. The negi-o score in this 
trait never increased enough, however, to bring it up to the lowest 
score of the whites. In such n trait as resistance to opposition, 
the increase in white scores, while the negro scores remain nearly 
constant, may indicate an earlier maturity on the part of the 



48 McPADDEN— DASHIELL 

negro. The decrease in scores for the white students in interest 
in detail may indicate, aa noted above, an increased valuation of 
time. 

In order to check the above classification of the groups into 
age-sections, another classification was made, this time into grade 
sections. Here it is evident, the factors of intelligence and greater 
capability come into play, and we may be fairly sure that the 
higher the grade, the higher the intelligence level, since there 
is a selective factor at work to eliminate those of less native 
capacity. Table V gives the mean scores attained by the various 

TABLE v! 

Mean scores by school grades of subjects. 

wiiiTi-: sTi iiKxrs 

Grade SM FL F SD Imp. RC RO FJ Inh. ID CI VP 

Hs 1-2 ;t..=sr. c.4i! :i.ii;i 2.tc .'i.To 5.G0 5.50 5.:i6 ■1.36 e.ie 3.00 5.66 

HS 3-4 fi.25 7.02 4.87 4.87 4.00 5.12 5.50 6.50 5.50 7.50 3.62 5.86 
C 1-2 7.04 5.74 5.04 4.00 4..')3 6.8!) 5.74 4.88 6.96 7.22 6.44 6.58 
C 3-4 6.118 7.66 5.41 4.33 4.91 4.83 5.83 5.00 4.17 7.58 6.08 6.75 

XKfjiiii srrnK.sTS 
Grade SM FL F SD Imp. RC RO FJ Inh. ID CI VP 
HS 1-2 2.09 5.0!) 3.38 4.33 5.57 6.47 5.00 6.81 6.38 4.91 2.33 6.71 
HS 3-4 4.06 6.»2 4.23 5.18 5.35 7.23 5.12 5.65 7.23 7.29 1.88 5.88 
C 1-2 4.40 5.25 4.05 4.75 4.95 5.85 5.65 5.20 5.45 6.15 3.86 5.30 
C 3-4 3.85 5.79 3.95 2.95 4.84 6.37 5.42 4.21 3.79 7.58 3.89 6.10 
Average ages of above groups: 

HS 1-2 HS 3-4 C 1-2 C S-i 

Whites 16.3 17.0 19.74 20.33 

Negroes 17.66 21.59 21.2 25.58 

For distribution of ages, and numbers in each group, see Table 3. 

sections, and Figure 5 shows the profiles plotted from the data. 
In this case, with increase in grade, there is an increase in the 
scores of more traits than when the student's increase is in age. 
Inspection shows that there are increases in the scores for speed 
of movement, flexibility, resistance to opposition, interest in detail, 
co-ordination of impulses and volitional perseveration. Finality 
of judgment is the only trait in which there is a decrease. The 
scores for freedom from load, reaction to contradiction, and motor 
inhibition remain about the same, or vary irregularly. There is 
a slight increase in the scores for speed of decision and motor 
impulsion for the whites, with n decrease in these traits for the 
negroes. With increased intelligence and .itrungcr personality, one 
would naturally expect higher scores. For finality of judgment. 
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the decrease ia from above "5" to about "5" which is the normal 
score. The advanced students seem to be less addicted to hasty 
revision. The constancy of the traits freedom from load, reaction 
to contradiction, and motor inhibition, may indicate that normal 
scores in these traits are sufficient for proficiency in school woric. 

Figure V 
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although it would seem that the advanced student would gain in 
resistance to contradiction. The opposite direction in which the 
scores tend, for the two races, in speed of decision and motor 
impulsion is probably indicative of racial characteristics, and may 
offer good returns for further investigation. 

Since, as stated in the first part of this section, a study of mean 
or median scores offers little that is definite in the way of racial 
temperament patterns, the scores for the college students were 
gone over in an attempt to list any tendency toward groupings of 
the high scores found there. Following Professor Downey in the 
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main, we may suggest that there are three types of such gmup' 
ings — those in the traits listed as the Rrst four characterizing one 
as mobile or rapid-fire in organization, as the second four charac- 
terizing him as aggressive or forceful, and as the third four the 
controlled, deliberate, careful type?. Also, there may be combina- 
tions of any two groupings, or of none at all — the profile may 
be balanced or else very irregular. The method followed here 
in listing tendencies was as follows : The first four scores in 
each individual's case were added together, as were the second 
and third sets of fours. These sums were compared, and when 
the sum of one group exceeded the sum of either of the other 
groups, the individual was listed as being characterized by the 
tendency correlated with that group. Where no one group ex- 
ceeded either of the others by three or more points, there were 
two possibilities — either that the individual had a well balanced 
proAle, or else there was a combination of two high groups and 
one low one. If the first was the case, he was listed as "Balanced"; 
if the second was the case, he was listed under the combination 

TABLE VI 

Showing distribution of college students according to the group of 
traits in which each received his highest scores. 
1st 2nd 3rd 1st and 2nd 2nd and 3rd Ist and 3rd Balanced 
Whites ...4 GUI 6 5 3 

Negroes 2 S 8 4 8 3 5 

of his two high groups. Table VI gives the results of this attempt 
to classify the patterns. From this table wc may see that the 
whites slightly surpass the negroes in the number of mobile, rapid- 
fire indi\iduals; they have a clear superiority in the number of 
controlled, deliberate, careful persons; and they slightly surpass 
the negroes in the number of individuals showing a combination 
of these two characteristics. The negroes slightly surpass the 
whites in the number of aggressive persons and in the number 
of persons combining quickness and mobility with aggressiveness, 
and also in the number of individuals combining aggressiveness 
and <leliberation. 

As a last point. Professor Downey suggests that, while there is 
not as much significance attached to the total score of each individual 
an to his scorcn on various traits, still, a high total score is, in 
general, indicative of a "stronger personatity," and a low total 
score is indicatix'e of a weaker personality. On this assumption, a 
tabulation of total scores of the college group was made, and a 
distribution curve was drawn from the results. See Figure 6. 
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FIGURE 6. 
Distribution of total scores of College students. 



N^ro 
White 




White C8.08 70 

Negro 59.05 57 

Six negroes (15.4^) passed the white median. 



It was found that the white coIlc;;e students surpassed the negro 
college students in their totals, which, therefore, would indicate, 
that, in general, the whites have "greater force of personality," 
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SUMMARY 



1. In general, the negro is slower in movement than the white, 
has about the same or slightly greater load or inertia; has slightly 
less flexibility: is slightly quicker in making his decisions; his 
motor impulsion is slightly greater; reacts more firmly against 
contradiction; but offers less resistance to physical opposition; 
takes about the same or slightly leas time in reconsidering his 
decisions; the negro college student has leas motor inhibition, the 
negro high school student has greater, compared with white stu- 
dents; the negro has practically the same interest in detail as the 
white, has markedly less ability in co-ordinating his impulses; and 
has a slightly less tendency to volitional perseveration. 

2. There is little difference in variability, but the negro college 
student has greater variability on seven of the traits, as opposed 
to the greater variability of the whites in five, and the amount of 
the negroes' variability is slightly greater. 

3. In general, the negro college and high school student is 
from two to three years older than the white student of the same 
academic grade. 

4. As to the influence of age (from early adolescence to the 
middle twenties, as the subject approaches maturity, there is a 
tendency for increased scores in speed of movement, flexibility, 
reaction to contradiction, and co-ordination of impulses; a tendency 
for decreased scores in speed of decision, finality of judgment 
motor inhibition, and volitional perseveration, the scores for motor 
impulsion tend to remain about the same; in freedom from load, 
the white scores remain about the same, or decrease slightly, and 
the negro scores increase with age; in resistance to opposition, the 
white scores increase and the negro scores remain about the same; 
in interest in detail, the white scares decrease, while the negro 

5. As to the analysis of mean scores by grades (probably in- 
fluenced by the factor of increasing intelligence in direct ratio to 
the higher grades): the scores for speed of movement, flexibility, 
resistance to opposition, interest in detail, co-ordination of im- 
pulses, and volitional perseveration increase in the higher grades; 
the scores for freedom from load, reaction to contradiction, and 
motor inhibition vary; there is a slight increase in the scores for 
speed of decision and motor impulsion for the whites, with a de- 
crease in these traits for the negroes, from the lower to the higher 
grades. 

6. In predominance of temperamental patterns, the whites 
slightly surpass the negroes in the number of mobile, rapid-fire 
individuals; they have a clear superiority in the number of con- 
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trolled, deliberate, careful persons; and they slightly surpass the 
negroes in the number of individuals showing a combination of 
theae two chflracteristica. The negroes slightly surpass the whites 
in the number of aggressive persons and in the number of indi- 
viduals combining quickness and mobility with aggressiveness, and 
also in the number of individuals combining aggressiveness and 
deliberation, 

7, In "strength of personality," as indicated by the total score 
of each individual, the whites surpass the negroes, only 15.4 per 
cent of the negroes exceeding the median of the whites. 



A STUDY OP THE DATA ON THE RESULTS GATH- 
ERED FROM REPEATED MENTAL EXAMINA- 
■ TIONS OF 200 DEFECTIVE CHILDREN 
ATTENDING SPECIAL SCHOOLS 
OVER A PERIOD OF EIGHT 
YEARS 
By Meta Anderson 
Director Binet Classes, Newark, N. J. 

Althou;;h the work for dofcctivcs was b;.'^un in Newark in Sep- 
tember, 1910, it was not until 1913 that the organization of the 
work permitted anything like systematic re-cxami nation of the 
children admitted to the special schools and even then complete 
yearly ve-examinatinn of the whole special school population was 
not accomplished. However, since I'M) it has been possible to 
re-examine each child in the special schools yearly excepting: a 
few eases which will be noted later. The object of the work was 
to get information in rcgfard to the grrowth of intelligence of 
the children in the special classes <now called Binet Classes) in 
order, if possible, to know better how to train them and to 
eliminate errors in their traininfr and education. The object of 
this study was to organize, cla.ssify and analyze these data in 
order to get further information in regard to types of mental 
growth curves and in order to get further information in regard 
to the value of the intelligence quotient. 

While the population of the Binet Schools is upward of five 
hundred pupils only two hundred were studied here. These two 
hundred cases vary from the grade of low grade imbecile to 
that of high grade moron. Before January, 1!)1@. the cases were 
selected for the Binet schools because they were failures in the 
regular grades and at the same time fell more than three years 
below normal according to an intelligence test (this standard 
being set by the New Jersey law). Since Januarj', 1918, the 
cases have been selected by the Psycho-Educational Clinic of the 
city. Each case is certified as being definitely feeble-minded 
before being sent to a Binet School. 

Each case was examined from three to eight times at not less 
than a year's interval. The majority of the cases were re- 
examined by the wTiter. The others were examined by two head 
assistants in the department both of whom were unusually well 
trained to do the work. 

In a department always having a population of 500 defective 
children it would seem possible to have numbers of retests on 
at least that many children. This investigation has shown that 
the turnover in the population of the Binet Schools is very great. 
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Many of the children except the lowest grade are assigned to 
special work late in their school career. These children are not 
presented for p?yrhological examination until the regular schools 
have done all in their power to help them succeed in their work. 
Hence, it is only after their inability to learn has become must 
marked or their behavior disorders have become unbearable that 
these children are assigned to the Binet Schools. By that time 
the children are anywhere from ten to fourteen years of age. 
Sir.c; they leave school at sixteen and sometimes earlier as 
during the war when the pressure for workers was very groat 
these children have short opportunity for training. This also 
renders it impossible to have a groat number of retests on the 

A ccrtn'n peLTcntaga of this group also leave school to go to 
hou: ?n of ctrrcctioij, to institutions, move from the city or are 
lost track cf. Thereiore th^' number remaining in the Bintt 
Schools f^r RTore than four years is comparatively few. 

With tho prer.LUt widiir use of group tests defective children 
aL-2 ho'.v.:x disrnvered i^arlier in their school career but It will be 
necessarily a number of years before sufhcicnt data are gathered 
on this new group for a worthwhile study. 

Before 1918 the Goddard revision of the Binet tests were used, 
since 1918 the Stanford revision of the Binet testa have been 
used. 

The study falls into two parts. The first part has to do with 
the frequency of types of mental growth curves and the second 
part has to do with a study in values of the IQ. 

PART I. 



OTIler. I.NVr.ETIi.ATIONS. 

Kuhlman has made growth curves on data gathered from re- 
peated retests on inmates of the Minnesota institution and he 
says: "The main features of these growth curves present but 
little that is not now pretty well known. They show that the 
feeble-minded do develop mentally, and at a rate in proportion 
to the grade of intelligence. This was still a disputed point at 
the time this study was begun. This rate of development de- 
creases with age for all grades. The rate of this decrease 
cannot, of course, be shown with this data, as we do not know 
how much mental growth in terms of absolute units the mental 
year represents at different age levels." 

Kuhlman summarizes his results on mental age growth as 
follows: 
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"1. The mental &ge& of the feeble-minded increase with age 
at a rate proportionate to the degree of mentnl deficiency. 

"2, On the whole the mental age censes to increase between 
the ages of fifteen to eiffhteen, the idiot grade ceasing develop' 
ment about three years earlier than the borderline grade. 

"3. For the cases figuring in the present study and for the 
time period they were under observation, 4.8 per cent of the 
cases gained twelve months or more in mental age in a year, 68 
per cent gain from one to eJeven months a year, 11 per cent 
gain or lose less than one month a year, and IG per cent loae 
from one to seven months a year in mental age. 

"4. The lower grades lose more frequently in mental age than 
the higher grades. 

"5. The frcQuency in loss in mental age increases with age, 
independently of grade.'" 

Doll says on the rate of growth for suljnormals: "Not much 
more is known about the rate of mental growth among extreme 
subnormals, like the feeble-minded, than about the age of arrest. 
In this regard we are even at a loss for adequate observational 
data. Experience with institutiunal feeble-minded, however, sug- 
gests a great variety of possible forms of retardation curves. 
Such experience points to a small but significant group of feeble- 
minded who grade 'at age' by the Binet scale when first ex- 
amined but who make no material progress in later examinations 
over a period of years (Type A.> There are others (Type B) who 
at the time of first examination test at age, then continue to 
develop at a retarded rate for a time and then reach a point of 
arrest. There is a third group (Type C) already retarded when 
first observed, who from the first examination to the age of final 
arrest develop at an annual rate of growth which is a con- 
stantly decreasing variable. There is also a fourth group (Type 
D) who from the time of first examination to the age of final 
arrest. There are many variants and combinations of these 
basic types for individual subjects. We believe, however, that 
these four types comprise the majority of the feeble-minded. It 
is conceivable, though not probable, that some individuals might 
have a higher than average rate before retarding. It is also con- 
ceivable, though not likely, that the arrest might be relatively 
greater in the early ages with a curve of growth which would be 
accelerating at some intervals. It remains for experimental in- 
vestigation to show the relative frequencies of these different 
types of growth curves.'" 
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With the view of detcrmininK what liyht, if any, the limited 
data on hand could throw on the subject of the growth of intelli- 
gence of feeble-minded subjects 100 mental ajre (frowth curves 
of pupils attending the Binet Schools from thret; to eight years 
were plotted. These curves were then classified nccording to 
Doll's theoretical intelligence growth curves as follows: 

Type A. (Doll) Those who test "at ojre" by the Binet scale 
when first exaniined but make no material [Togress in later ex- 
aminations. 

Type B. (Doll) Those who at the time of first examination test 
"at age," then continue to develop at a retarded rate for a time 
and then reach a point of arrest. 

Type C. (Doin Those who nre already retarded at time of 
first examination but who continue to develop from the time of 
first examination until time "I final arrest at an aniiual iT.te of 
growth which is a constant"? decreasing variable. 

Type D. (Doll) Those who from the time of first examination 
to the age of final arrest develop at a constant rate up to time 
of final arrest. 

For convenience two new types were added although it is quito 
likely they could be easily included in one of the abov.- i^oups. 
They are as follows: 

Type E. (New) Those who are retarded at the time of first 
examitiaticn, and who also have apparently reached th? t!:ne of 
final arrest. 

Type F. (New) Those who have developed at a constant or 
variable rate up to the time of apparent arrest, but who after 
two to four years of apparent arrest, have l)egun to develop 

NUMBER OF CASES TYPE 



100 
Of the 11 cases listed as type f there were 

4 who remained at an apparent arrest for 2 years, 
fi who remained at an aooarent arrest for 3 years. 
2 who remained at an apparent arrest for 4 years. 
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Of those 11 cases lisU^l as tyjic f there were 

2 cases who continued development for 1 year after arrest. 

6 cases who continued development for 2 years after aiTest. 

2 cases who continued development for 3 years after arrest. 

1 case who continued dovelitpnient for 4 years after arrest. 
at which time there was another apparent arrest or the childrei 
left school. 

Ttiiie f cuifa elni<::ific<l ur.cordh.ij !•> life itgc 

Numlier of Cases Life Age 

1 6 to 7 

I T tu 8 

5 to 10 

1 10 to 11 

2 11 to 12 
1 12 to Vi 



Tiii'f f I'fiNfK cUi^sififl tic<-i;-Oi,iy lo mriiltil age 
Number of Cases Mental Age 

2 :j to 4 



SUMMARY. 

1. It is evident that a greater number (47) of the cases studied 
in this group have developed mt'ntally according to Doll's theo- 
retical curve described as Type C. 

2. ThL- next larger group (22) of cases studied have devctop?d 
mentally according to Doll's theoretical curve described as Type D. 

:). There were 07 cases out of the 100 studied who were rs- 
tarded when first examined and who then retarded cither at a 
constant rate or at a steadily decreasing rate up to age of final 
arrest. 

4. Only one <1| case could b-- ob\nou»ly classified under 
Type A. 

I). The 10 oases which were retarded when first CKamined and 
which developed no further at later oxaminr.tions may or may 
not belong to Type A.TIiat is, it is possible that if they had been 
exanniied at earlier periods they would have tested "at age." 
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G. The 11 cases under Type F could be classified under Type 
C in a broad classification. They differ from that type merely 
in the fact of ha%'ing long periods of arrest but in the long run 
they develop at a decreasing rate up to the time of final arrest. 

7. It would appear from the study of those 100 cases that 
the majority 80 in this study of feeble-minded cases slow up 
gradually in mentality up to time of finul arrest and that com- 
paratively few develop normally for a time and then atop .lud- 
denly. In this study not more than 20 of thu cases could have 
been said to have come to sudden arrest and 19 out of the 20 
cases are doubtful. 

8, The 100 eases studied were all classified as feeble-minded 
and were attending Binet Schools. It is possible that feeble- 
minded cases which develop normally and then retard suddenly 
are not discovc'retl early enough in their school careers t6 be 
selected for Binot Schools. 

Part II. Study in Some Valuks of tme 1. Q. 
From three to seven tests were made on 200 children attending 
the Binet Schools at intervals of a year in most cases. There 
are cases which are noted in which the retests were made ut 
greater intervals because the children were not available for 
examination either because ihey had moved from the city or 
attended another school and then re-entered the Binet School 
when they were re-uxamiiied. At the time of this study there 
were only two hundred cases who had been re-examined a suffi- 
cient number of times to make the study of their cases worth 
while. These cases then were all selectotT because they were 
attending the Binet Schools and because they had attended long 
enough to have from two to six retests made at intervals of a 

The casss were classified and grouped. 

(a) According to life age at initial test and I. Q. in groups 

(b) According to I. Q. in groups of tens. 

(c) According to I. Q. and intervals of retests regardless of 
life age. 

These groupings were made in order to study the I. Q. in its 
various aspects. 



No. of Cases. Life Age. Median I. Q. Number Median I, Q. 
at of at 

First Test. Betests. Last Test. 



54 


3 


49 >^ 


&SM 


3 


5H4 


54^4 


4 


51 


57 


3 


48^4 
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No. of Cases. Life A^. Median I. Q. Number Median I. Q. 
at of at 

First Test. Retesta. Last Test. 



SUMMARY OF RESULTS. 

1. The cases with I. Q.'s from 30 to 39, irclusive, and with life 
ages from six to nine years, inclusive, showed a gain in median 
1. Q. of 2 to 11 points. 

2. The cases with I. Q.'s from 30 to 39, inclusive, and with life 
ages from 10 to 13, inclusive, showed a loss of 6 to 7 points in 
median I. Q. 

3. The cases with I. Q.'s from 40 to 49, inclusive, and with life 
a^s of 6 years showed a loss of 2 points in median 1. Q. 

4. The cases with I. Q.'s from 40 to 49, inclusive, and with 
life ages from 8 to 11, inclusive, showed a gain in median I. Q. 
of 2 to 4 points. 

5. The eases with I. Q.'s from 40 to 49, inclusive, and with the 
life ages of 12 showed a loss in median 1. Q. of 5 points. 

6. The cases with I. Q.'s from 60 to 69, inclusive, and with life 
ages from 6 to 12, inclusive, showed a loss in median I. Q. of 
nothing to 9 points. 

7. The cases with I. Q.'s from GO to 69, inclusive, and with life 
ages from 6 to 13, inclusive, showed a loss in median I. Q. of 7 to 

2. The cases with L Q.'s between 40 and 49 showed a loss of 1 
12 points. 

8. The cases with I. Q.'s from 70 to 79, inclusive, and with life 
Bges from 6 to 12, inclusive, showed a loss in median I. Q. of 10- 
to 26 points. 

9. In other words, the younger cases with I. Q.'s from 30 to 39' 
inclusive, gained in median 1. Q.; the older cases with I. Q.'s from 
30 to 39, inclusive, lost in median I. Q. 

10. With the exception of the 6-year-olds who lost 2 points in 
median I. Q. the younger cases with I. Q.'s from 40 to 49, inclusive^ 
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gaine<I in median I. Q.; the older cases with I. Q.'s from 40 to 49, 
inclusive lost in median I. Q.'a. 

11. All cases of any age with I. Q.'s from 50 to 80, inclusivp 
showed a loss in median I. Q. 

11. CASES •.'LASSIKIBK A*'fI>RDlNO TO ly 

No. of I. Q. Range Median I.Q.'s at Successive Examinations. 
Cases 12 3 4 6 G 

14 30-39 35 33 31 30 37 

29 JO-49 47 49 46' 48 46 

63 50-59 56 56 64 51' 50 48 

59 60-09 65 GO GO 58 GO 67 



SUMMARY. 

1. The cases with I. Q.'s between 30 and 39 showed a gain of 2 
points in median 1. Q. at the 5th re-examination, 
point in median I. Q. at the 5th re-examination. 

3. The cases with 1. Q.'s between 60 and 59 showed a loss in 
median I. Q. of 8 points at the 6th re -examination. 

4. The cases with 1. Q.'s between 60 and G9 showed a loaa in 
median I. Q. of 8 points at the 6th rc-exa mi nation. 

5. The caiies with I. Q.'.s between 70 and 79 showed a loss in 
median I. Q. of 17 points at the 6th re-examination. 

' 6. All cases with I. Q.'s helow 50 remained practically sta- 
tionary with a gain or loss of but I or 2 points in median I. Q, 

The cases with I. Q.'s between 70 and 80 showed loss. The 
highest initial I. Q. showed the greatest loss in mediah I. Q. at 
the final re -ex a mi nation. 



>/hi, 
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I ly AMI ALSO A<M'i»KDIN»! 

IQ Median IQ's at initial test and at intervals of retests 



12 30-39 


34-32^ 






10 30-39 




33=-28= 




13 30-39 




34-33 




fl 30-39 




34-37 




5 30-39 






39-42 


33 40-49 


46-48 






24 40-49 




46-45" 




20 40-49 




44-48 




13 40-49 




44-42 




7 






44-43 


67 50-59 


56-56 






64 50-59 




56-63 




40 50-69 




55^-56= 




19 50-69 




55-50 




12 50-59 






63--48 


7 50-59 






56-49 


74 60-09 


65-61 






64 60-69 




65-60 




43 60-69 




65-58 




21 60-69 




67-60 




9 60-69 






65-56 


33 70-79 


73-67 






31 70-79 




73-62 




25 70-79 




73-61 




16 70-79 




72-58 




11 70-79 




SUMMARY. 


72-56 


AH miTilla 


a ura in 


all niiiK.'s ^Lo«...l a l.-^s 


as fnlli'ivs: 


Range of IQ. 


Points lost at succ 


Bsive examinations. 
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In each group of cases the theater loss in median IQ occurred 
at the end of the fifth examination. 

In each group of cases the Kfeatest loss in median IQ occurred 
in the groups of the higher initial IQ's, 

CONCLUSIONS. 

1. A great majority of the cases who are examined as candi- 
dates for the Binet Schools are retarded at the time of first ex- 
amination and then retard either constantly or at a decreasing 
ratio up to time of final arrest. 

2. Comparatively few of the cases examined as candidates for 
the Binet Schools develop normally up to a certain age of arrest 
and then remain at arrest. 

3. In cases whose Intelligence Quotient is below 50 there is a 
tendency for the median IQ to remain constant or to gain or lose 
slightly. The median IQ shows n gain among the younger cases. 

4. All cases with IQ's between 50 and 80 show a decrease in 
median IQ at any age. The highest initial IQ's show the greatest 
loss in median IQ after repeated examinations. 

5. In the case of examinations at varying intervals the greatest 
loss in median IQ was at the interval of five years which was the 
last examination for all grades of cases. The greatest loss in 
median IQ was shown by the highest grade of cases. 

G. The IQ is variable in individual cases. 

T. No group of cases showed a marked increase in median IQ. 

8, These conclusions are merely for cases examined as Can- 
didates for &inet Classes. It is possible that repeated examinations 
on all retarded cases in a school system might give different re- 
sults. 



THE DOWNEY WILL-TEMPERAMENT GROUP TEST; 

A FURTHER ANALYSIS OP ITS RELIABILITY 

AND VALIDITY 



By G. M. RucH and M. C. Del Manzo, 
University of Iowa. 



This paper presents the results of a statistical analysis of the 
scores of one hundred and forty-six high school students tested 
with the Do%vney Group WUl-Temperament Test. The discussion 
of these results will be divided into four sections in accordance 
with the specific objectives of the investigation. 

I The Reliability of the Test as a Whole 
Since the Downey tests are published in only a single form the 
usual method of obtaining reliability coeHicients by correlating 
equivalent forms is not applicable here. Moreover, the common 
practice of breaking: tests into chance halves for purposes of ob- 
taining the self-correlation can only be carried out with certain 
qualifications as to the justice of this method. In an earlier pa- 
per', one of the authors has argued that the correlation of the 
sums of the odd-numbered tests ag-ainat the sums of the even- 
numbered tests might fairly provide an approximation to a valid 
coefficient of reliability. A few words in explanation of the nature 
of the Downey WiU-Temperament Tests will help to make clear 
the limitations of the method of correlating chance halves. 

The Bcale is composed of twelve separate tests each designed to 
measure one aspect of the total volitional pattern. These are: 

A Speed of Movement (VI-1) 

B Freedom from Load (VI-1, 2) 

C Flexibility (VIII) 

D Speed of Decision (I) 

E Motor Impulsion (X) 

F Self-Confidence (XI) 

G Non-compliance (XII) 

H Finality of Judgment (XIII) 

I Motor Inhibition (VII) 

J Interest in Detail (IX) 

K Co-ordination of Impulses (V) 

L Volitional Perseveration (VIII-2) 

<Rach, U. M.: "A I-n-llmiiiury Study at (h<- ('iirn'lullonH iH'tivcpn K»it- 
inat<>K nr Volitional Tnilis Dua the Ui'miltH (rum Ihc Dowify ■Wjll-Pri'llli'x'." 
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This arrangement of the tmlve traits into three groups u here 
indicated follows the purpose of the author of the test in that 
traits A to D belong; to a common "pattern"; traits E to H belong 
to a second "pattern"; and traits I to L belong to a third "pat- 
tern." The groupings are intended to throw together the tests 
that are intended to reveal, respectively, three main types of voli- 
tional temperaments known, in order, as: 

I "Hair-trigger" organization, or the explosive type of will de- 
scribed by James (Tests A, B, C, and D). 
n "Willful, aggressive pattern" (Tests E, F, G, and H). 
Ill "Slow, accurate, tenacious type" (Tests I, J, K, and L). 

The grouping and characterizations of the author of the tests 
is adhered to here strictly. 

Since the scale is of the nature of a diagnostic picture in which 
certain groups (the three patterns) of tests can logically yield 
uniformly high scores while other portions can as logically yield 
very low scores (or at least much lower scores), it follows that the 
total score on the whole acale will have very little meaning. It 
also follows that any attempt to split the total scale into chance 
halves must take care that equal numbers of tests be taken from 
each of the three diagnostic patterns in forming such chance 
halves. If this is done properly we would then have two half- 
scales; each half-scale being composed of two testa from each of 
the three patterns or a total of six tests in each half scale. Such 
chance halves could be made up in this particular case in several 
way, viz., (1) the grouping of all of the odd-numbered tests in 
one half-scale and all of the even-numbered tests in the other 
half-scale, (2) the grouping of the first two testa of every pat- 
tern into one of the half-scales and the last two tests of each 
pattern into the other half-scale, or, (3) the grouping of the first 
and last tests of each pattern into one half-scale and the second 
and third tests of each pattern into the second half-scale. 

In the paper mentioned above, the reliability of the Downey 
tests (individual form) was studied only by the first of these three 
methods. In the present report, the reliability coefficients have 
been determined by all of the three possible ways and the results 
averaged. Table 1 shows these reqults. The notations as "Method 
1," "Method 2," and "Method 3" refer to the above-mentioned 
ways of obtaining chance halves. The notation "r jj" means 
that the coefficient of correlation stated was obtained by correlat- 
ing half (six testa) of the scale with the remaining half (six 
tests) of the scale. The notation "ru" is the porpheeied correla- 
tion which would be obtained if two similar whole forms were cor- 
related. The values of the "ru" column were Calculated by ttia 
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UK of Brown's formula, n r 

r^ The ages ol the 

H-(n-l) r 
aubjects cover a range of from ten to twenty-nine years. Grades 
seven to twelve are involved. 

TABLE 1 

RBLIABII.ITY COEFFICIBNTS 





(Brown's formula) 


0.17 


0.29 


0.31 


0.47 


0.24 


0.38 


0.24 


0.38 



Average 0.24 0.38 146 

The probable errors of these coefikients (Pearson product-mo- 
ment formula) ran^ between 0.05 and 0.06. Table 7 shows the 
probable errors of coefRcienta of correlation for the various values 
of r reported in this study. 

In view of the wide range of talent represented in the group 
tested, these reliability coeflicients cannot be considered to be very 
satisfactory. They are, however, much higher than those pub- 
lished in the earlier paper cited; the range of talent in the former 
group bein^ very much more curtailed. 

There is another possibility which must be considered in accept- 
ing these reliability coefficients at their face value. According to 
our original assumptions, the reliability of the scale as a whole 
can only be obtained by the methods we have used tn cage tke 
tests are correctly grouped into patterns in a proper manner. The 
low reliability which we have found might mean merely that the 
tests are improperly classified at present. In this case, the true 
reliability of the scale (properly arranged) might be markedly 
higher than vre have reported. Discussion of this question of the 
grouping of the separate tests should be postponed until the inter- 
correlations of the tests have been presented. 

II The Internal Coherence op the Scale 

One of the crucial issues in the evaluation of the Will-Tempera- 
ment Test is the matter of the arrangement of the separato ele- 
ments into the diagnostic patterns. As the authors interpret Dr. 
Downey's classification of the individual tests into groups which 
picture volitional patterns, it would seem that a valid grouping 
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would imply certain mutual relationships among the tests. These 

(1) High scores in one test of a pattern would be paralleled with 
high scores in the other three teats of the same pattern. This 
is equivalent to saying that the inter-correlations between 
tests of a given pattern would tend to be positive and high. 

(2) Correlations between each test and the composites of the 
tests of the same pattern would tend to be positive and "high. 

(3) The correlations between tests of one pattern and those of 
the other patterns would tend to be zero or very low. 

(4) Correjations between single tests and the total score on the 
scale would be low in all probability and not significant for 
purposes of evaluating the tests. 

In order to test these assumptions about the proper grouping 
of the tests of the present scale, the correlations of each teat with 
the composite (sum) of the other three tests of the same pattern 
have been computed. For obvious reasons the test used as one of 
the variables in the correlation must be omitted from the com- 
posite. Table 2 shov;3 the obtained correlations. 



TABLE 2 




niK TIWTS WITH 


TUB CuMF 


Compoaite 


r 


B+C+D 


0.54 


A+C+D 


0.28 


A+B+D 


0.10 


A+B+C 


0.39 


P+G+H 


-0.08 


E+G+H 


-0.23 


1 + F+H 


-0.13 


E+F+G 


-0.09 


J+K+L 


0.07 


r+K+L 


0.33 


I+J+L 


0.07 


I+J+K 


0.05 



The average inter-correlations of the teats within a pattern is 
probably even a better method of testing the general validity of 
the grouping into patterns. Table 3 shows the resulta yielded by 
this method. 
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TABLE 3 




XTER -CORRELATIONS 


; OK THE TESTS OF 


THE 8A1IE PATTERNS 


VariabU 1 


Variable 2 


r 


A 


B 


0.86 


A 


C 


0^8 


A 


D 


0.37 


6 


C 


. -0.05 


B 


D 


0.33 


C 


D 


0.05 


Average 




0.22 


E 


F 


-0.05 


E 


* G 


0.00 


E 


H 


-0.02 


F 


G 


-0.16 


P 


H 


-0.15 


G 


H 


0.01 



I K 0.12 

I L 0.00 

J K 0.24 

J L 0.18 

K L -0.18 

Average 0.07 

General inspection of Tables 2 and 3 shows that the correlations 
between the separate tests are uniformly low, the second pattern 
(Tests E to H) being' the most unsatisfactory. It would be inter- 
eating to pick out from each pattern the best tests if this could be 
done easily. This would properly be done by multiple correlation 
methods and the labor involved would not seem to be justified by 
the general promise of the coefRcients reported. In pattern one, 
it would appear that Tests A and D would prc^ably be found to 
be considerably superior to the other two. In pattern two, there 
is no promise that multiple correlation methods would reveal any- 
thinsT of significance. In pattern three. Tests J and K wonld ap- 
pear the most promising. 
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III Correlation of thb Will Traits With Gbnbral 
Intelligence 

Table d shows the correUtions obtained between the scores in 
the twelve separate will testa and the averages of two standard 
group tests. The latter are the Terman Group Test of Mental 
Ability and the Morgan Group Mental Test The reliabilities ot 
each of these tests is known to be well above 0.90 for ranges of 
talent comparable with those represented in the group considered 
here. The significance of the coefficients of correlations of Table 
4, like those of all of the preceding tables, is obscured by the 
fact that the reliabilities of the separate tests are unknown and 
are probably very low in many cases. 

TABLE 4 



0.16 

-0.03 
0.20 
0.11 
0.14 

0.18 



L -0.05 

None of the above correlations is high enough to lend any sup- 
port to the possible criticism of the Downey tests as being meas- 
ures of general intelligence. The factor of intelligence undoubt- 
edly does enter into some of the tests but not to an extent that 
would invalidate the scale on this score. 

The inter-correlations between the testa have also been deter- 
mined independently of the influence of intelligence by means of the 
usual methods of partial correlation. Table 5 shows such partial 
coefficients. The notations "''AB.i", "'AC.i", etc., read: The cor- 
relation between traits A and B which is independent of the in- 
fluence of intelligence, and similarly, for the correlation between 
traits A and C, and the others. 
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THE COKREL^TIONS BETWEEN THE SBPABATB TRAITS WHICB 

BXIST8 INDEPENDENTLY OP THE FACTOR OK INTELLIQENCE 

(OBTAINED BT PARTIAL COEBKLATIONS) 



ACi 

AD.i 
'bCi 
'bD.! 
'cD.i 



0.33 
0.22 
0.34 
-0.09 
0.31 
0.02 



GH.i 



-0.04 


'u.i 


0.03 


0.00 


IK.i 


0.07 


-0.02 


IL.i 


0.01 


-0.17 


JK.i 


0.14 


-0.16 


JL.i 


0.21 


0.00 


KL.i 


-0.18 



By referring to Table 4 again it will l>e seen that there has been 
little change resulting from the uae of partial correlations in elim- 
inating the influence of the factor of intelligence. It may be con- 
clude4 that whatever inter-correlatior does exiats between ths 
various separate tests of the same patterns is not produced by 
the common factor of intelligence. The formula used in partial 
correlation is the usual one, following Yule's notations: 



IV The Validity of the Downey Scale 
The validation of any test of psychology capacities is at best 
a most dilDciilt task. To this rale the Downey scale is probably 
no exception. For an account of the derivation of these tests the 
reader is referred to the manual (or use with the Will-Tempera- 
ment Scale*. 

In the earlier paper to which reference has several times been 
made, it was attempted to secure ratings from competent judges 
acquainted with the subjects on each of the twelve traits of the 
Downey scale. A similar procedure has been adopted in the pres- 
ent study with certain modifications. It was thought that the 
teachers of the high school pupils under study might be able to 
furnish a set of ratings on the twelve traita which would have 

. >Dowiie7, June E: "Tbe WtJI-IVoBle." Unlvenltj ol WyomlDE Bulletin, 
Vol XVI, NO. 4b, NoTemtttr, UUi. 
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value as a criterion against which to evaluate the tests proper. In 
adopting: this plan, the authors were by no means ignorant of the 
many pitfalls in subjective judgmenta. As shown in certain 
of the published studies, it is possible, at times, with sufficient 
care, to obtain reliable subjective estimates in the sense of high 
self-cori'elation among the judges. However, high reliability, al- 
though admittedly highly desirable for such purposes, does not 
guarantee that a valid criterion has been built up. The question 
of the validity of such criteria is by far the more serious issue. 
The fact that ten persons rating a group of individuals for "ini- 
tiative," "leadership," or "tact" agree with a reliability equal to 
0.75 or higher means merely that they are rating the same thing 
or some other thing highly correlated with this thing, but it does 
not follow of necessity that the ratings correspond to the psycho- 
logical functions which by hypothesis underlie the thing beinf 
rated. Teachers can furnish ratings on their pupils upon such 
traits as "persistence," "conscientiousness," "originality," "hon- 
esty," and a host of other traits with a fair amount of reliability, 
yet careful statistical analysis will reveal that little elae.ia in- 
volved in these various separate trait ratings than the teachers' 
general estimates of the quality of school work being done by these 
pupils. In other words, almost es good results could be obtained 
by asking for estimates of school work and then using these, in 
turn, as estimates of "persistence," "originality," "conscientious- 
ness," etc. The estimates, then, are clearly not valid except as 
these traits are genuinely correlated with the quality of school 
work and even then it is a very indirect type of measurement. 

On the other hand what conclusions can be drawn from the 
Mtuation of judges not being able to agree upon the presence or 
absence of quantitative statement of psychological traits tn b 
froup of individuals known to the judges? Does failure to show 
self-correlation in chance halves of these seta of estimates carry 
with it any important implication? Does such a negative result 
with respect to a paycbolo^cal trait prove th»t the trait in ques- 
tion has no true psychological basis? No universal answer can be 
given to these queries. In the case of many reputed psychological 
rubrics it probably does mean that there is no real evidence for 
assuming the reality of such traits as true mental functions. In 
other cases if not in most the answer is left in an undeterminate 
status, i.e., the experimental results are entirely non-committal in 
the sense that they farnfsh no evidence, positive or negative, upon 
the issue of the existence or non-existence of the trait in question. 
Even at this it mi^t for all practical purposes be argued that 
unless competent persons are in fair agreement about the presence 
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-or absence of reputed psychological characteristics there Js no 
direct way of identifying such traits for purposes of study. 

With these limitations of the method of estimates in mind we 
can return to the discussion of the immediate problem. In the 
attempt to build up a criterion for purposes of correlation of the 
trait scores with a second measure of the same traits the high 
school teachers of the pupils in our present study were asked 
simply to nominate the ten pupils in their classes who possessed 
the "strongest will-power" and the ten who had tlie "weakest will- 
power." No attempt at further definition of these directions was 
made. The reactions expected were those of the man on the street. 
The only outcome which was expected was that the pooled nomi- 
nations might reveal two groups widely spaced upon a scale of 
"will-power" in the conlmon meaning of that term. When the 
nomination blanks were received it was found that certain pupils 
were invariably reported inr the same category. A larger number 
were about as often placed in one group as the other and a still 
larger number were never once nominated for either classilicatian. 
There was, then, evidence of marked agreement in many cases, 
the total number of complete agreements being roughly 20 per 
cent of the total of one hundred forty-six pupils in the high school 
under study. Twenty-eight pupils involving equal numbers of the 
sexes and equal numbers in each of the two categories (i.e., "strong- 
willed" and "weak-willed") were selected for further study. The 
agreement was perfect or practically perfect in these cases in the 
sense that either three or four of the four teachers acquainted 
with every pupil placed him in the same category and no teacher 
.gave a dissenting vote in any of these cases. The reliability coeffi- 
cient for this final group was not determined but its general na- 
ture is assuredly high by virtue of the method of forming the group. 
Instructions were then sent to every teacher who had nominated 
any of the pupils in the final group to rate each pupil upon each 
of the twelve traits of the Downey scale. The trait descriptions 
were taken verbatim from the author's manual for use with these 
tests. 

The final group therefore comprised (to the best knowledge of 
.all of the teachers of the school) the fourteen pupils of the school 
showing the most marked volitional characteristics and an equal 
number most lacking in these same characteristics. As well as 
could be done by estimation we had segregated the highest and 
lowest ten per cents of the group as a whole. Table 6 shows the 
Gorrelationa found between the pooled estimates of the teachers 
and the test scores in each of the twelve traits. Inspection of 
these coefficients of correlation does not reveal very definite evi- 
4lence of the ability of teachers to identify the various traits tested 



74 RUCH— DEL HANZO 

by the Downey scale. Whether this eitUBtion ean be fnterpreteJ 
aa meaning that the Downey scale is of doubtful validity is very 
questionable. A utner conclusion would be that teachers are un- 
able to identify the traits of the Downey scale in their pupils to 
any considerable extent (traits J and K, and possibly traits A. 
and C being' apparent exceptions). It is probably fair to assume, 
however, that the Downey teats cannot be validated by the method 
of subjective estimates with any high amount of assurance. The 
correlations between estimates and test scores are in general of* 
about the same magnitudes as those reported in the earlier study 
(where the range was from -0.33 to 0.61 for the pooled estimates, 
of three or four college professors; the average being 0.07). The- 
average estimate-test correlation is 0.15 for Table 6. 



TABLE 6 


.NH KETWEEN ESTIMATES AN 


r Trait 


r 


0.37 E 


0.19 


0.02 F 


-0.03 


0.30 G 


-0.04 


-0.29 H 


0.17 



J 0.61 

K 0.53 

L 0.17 

The probable errors of the coefficients of correlation in Table G- 
can be found in Table 7 to a sufficient accuracy for our purposes- 
The same is true of the correlation coefBcients given in Tables L 
to 5. Except in Table 6, the numbers of cases have invariably been 
one hundred and forty-six. 

TABLE 7 

A RBFEHE.VCE TABt.E OP TROBAItLE ERRORS OF PEARSON CO- 
EFFICIENTS OF CORRELATION FOR YAI,I:ES f" - 
APPEARING IN THE FOREGOING T 



Probable Erors of t 



0.00 
0.05 
0.10 
O.IS 
0.20 
0.26 
0.30 
0.36 
0.40 
0.46 
0.S0 
0.66 
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CONCLUSIONS. 

The following points are Bagfested as sutnmarlzing the more im- 
portant findings presented : 

(1) The reliability of the Downey Group WUl-TempeTament Teat 
is probably not hig'her than 0.40 as an estimate of the corre- 
lation which would be found between two similar forms of the 
tests were a second form available. I,t is no doubt true that 
certain of the patterns are more reliable than others, a fact 
which militates against the reliability of the scale as a whole. 

(2) The validity of certain of the individual tests is doubtful. The- 
inter-correlations in patterns II and III are low, pattern I 
heij\g the most satisfactory. The same situation holds for 
the correlations of the individual tests with the composites of 
the remaining tests of the same pattern. 

(3) The lack of inter-correlation between tests of the same pat- 
tern in the case of pattern II, and to a less degree in the 
other patterns, may be due to either: <a) unreliability of the' 
individual tests (not determined in this study), or (b) faulty 
location of certain tests. In the latter case further study 
might suggest changes from one pattern into another. 

(d) There was found no reason to believe that the Downey tests. 
measure merely intelligence. The inter-correlations, where 
they are significally high, are not due to the common factor 
of intelligence. 

(5) The attempt to validate the separate tests of the scale by 
means of teachers' judgments yielded ambiguous results. It 
would appear that strict validation of the Downey tests by the 
method of estimates would be a very difficult task. We can 
conclude that, with a few exceptions, high school teachers 
cannot identify the psychological traits measured by the 
Downey tests by study of the characterizations of those traits. 
which have been published by the author of the testa. It 
should be pointed out that the estimates used in this study 
cannot be assumed to be valid, although their general relia-. 
bility is doubtless satisfactorily high for purposes of a rough 
criterion. The question of the validation of the Downey tests 
can better be dismissed by refertng the reader to Dr. Downey'a. 
manual, previously cited, for a discussion of this point. 

(6) In general there are a considerable number of teats in the 
Doiim«V WUl-Temperament Test that show promise of tending 
themselves to further study and development. Duplication of 
such tests and probably a number of substitutions will lead to 
a more valid instrument for the measurement of volitional 
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traits. The urgent need for such meaBUrements demands that 
the pioneer efforts of Dr. Downey be rewarded with the rec- 
ognition that much promising ground had been broken by her 
patient investigatidhs and that further progress has been 
made possible in this direction. 



THE FRESHMAN: THORNDIKE COLLEGE EN- 
TRANCE TESTS, FIRST SEMESTER 
GRADES, BINET TESTS 

By W. T. Root, 
University of Pittsburgh. 

INTRODUCTION. At the beginning of the academic year, 
1921-22, the College of the University of Pittsburgh* gave the 
Thorndike Intelligence Examination for High School Graduates 
t« a Freshman class of 569. The tests given were: Part I, Form 
I (designated as Tl) ; Part I, Form M (T2) ; Part II, Form D 
(T3) ; Part III, Form D (T4). The total, that is the sum of the 
four tests, is designated T5. The test was given without inter- 
mission other than the short intervals provided for in the in- 
structions. 

Results. The following averages were secured : 

Test Average 

Tl 105.119 

T2 105.276 

T3 101.504 

T4 32.97 

T5 341.61 

Final score (T6 divided by 5) 68.38 
Median score, 70 
Range 21 to 110 

Correlations between different forms. The forms were correlated" 
with the total singly and in combination: 

Test r (Pearson) P. E. 

T5 with Tl .848 .007 

T5 with T2 .829 .009 

T5 with T3 .904 .006 

T5 with T4 .754 .01 

T5 with Tl plus T2 .914 .004 

T5 with Tl plus T3 .960 .002 



*Tbc DfiinrtmE'iit of I'K}'vlioliiRy gavn and Bcured tlit^ tCBIs, Tlie wrltpr 
tn InilcbteJ to thp ffrndunle atuili^iilii in psrchnlogy for maoy wars honra 
uf statliitlral culfUlatlua. Sppflul nckuuHrlcilgnipat la ilne I'rulPBHor Klurpncc 
H. Tcneardeii fur tntDBmutlUK KrudCB Inio bIkdis valuee and for giving the 
Blaet TpalB to rh« Fri'shmfn glrlii, Mrs, Ida Nyiv Rout is to be Ihnnked fnr 
many diiyB BDfuC la the veiHtLuuR tank uf Blntlsticnl ruchPCklnB ami ul 
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The high eorrmlation of TI plus TS with T5 ntggntB v«nr 
etrongly that Tt and Ti b« etiminattd in future letting. This 
would mean a great eeoncrmy in the tirjie required ta give the teat, 
in the tirn« required to ecore, and in the cost of tett materiaU. 

Correlation of TS toith the academic gradee for the first semes- 
ter. In attempting to summate the academic grades the writer 
met with the uaual difficulties. It seemed best after all factors 
were considered to resort to the tedious method of transmuting all 
^ades to sigma values thus correcting for the great variance in 
distribution of A's, B's, C'a, D's, and F's. The sigma value waa 
weighted according to the number of units of credit the course in 
question carried. The weighted aigma values were added and 
divided by the number of unita of credit carried by the particular 
' Freahman in qneation. This procedure overcomes the injustice 
uaually experienced by studenta carrying "atifl" couraes (i.e., 
coursea with a high percentage of D's and F's and a low per- 
centage of A's and B's). The aigma values of A, B, C, D, and F 
were determined for each subject taught to Freshmen. D is the 
lowest pasaing grade while F is failure. 

The correlations between the academic gradea and the Thorn- 
-dike forms are as follows: 

Test r P.E. 

Tl with grades .42 .02 

T2 with grades .33 .03 

T3 with grades .36 .03 

T4 with grades .415 .02 

T5 with grades .SI .02 

The Thorndilce total was now correlated with each college sub- 
ject taken by the Freshmen, debarring a few in which the number 
of beginning studenta was too small to admit of correlation. (Tab- 
.ulation I> 
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The correlations are moderately high and considerable signifi- 
cance as N is large in the majority of cases and the group ii 
homogeneous. The correlation of the Thorndike test with Human 
Progress is conspicuously high (r. .689) with a very small prob- 
able error (P. E. .01). This course deals with a large number 
of the arts snd sciences in a semi -philosophical way. The classes 
are large ami a premium is placed on general information and 
linguistic ability. English I, Graphics 2, Mathematics 21 'and 
French 1 correlated less highly than the other courses with the 
Thorndike total. English may be a matter of home conditions, 
foreign parentage or drill and follow up work through four years 
of high school. The students enter Graphics and Mathematics with 
very different prepiirations ; French may be very easy for the stu- 
dent with a fair knowledge of Latin or one of the Latin languages. 
If Italian is spoken in the home it may prove to be a hinderance 
in an Enghsh course and a boon in a French course. One may 
speculate indefinitely as to the general causes for correlation or 
no n -correlation. 

The prognoatie valiit of the Thorndike CoUege Entrance Tests. 
It is possible to have reasonably high correlations without much 
justiRcfttion for applying the findings to an individual case. Dis- 
tinct sets of causes may be at work : thus, we may have nearly 
perfect correlation with a portion of the cases, a moderately posi- 
tive trend for a large median group, with a significant group show- 
ing a negative correlation. Again, we may have marked negative 
or positive correlation in certain regions of the data with an in- 
different correspondence in other regions. It becomes pertinent, 
then, to ask for an analyaia of the tendency to correlation or rank- 
correspondence as well as to compute the coefficient of correlation. 

The chief reason for administering the tests now under consid- 
eration to Freshmen is to predict their capabilities in connection 
with academic college requirements. It therefore seemed desirable 
to rate the Freshmen in some form of grade classification, ar- 
ranged in rank-order, and to compare this ranking with the Thorn- 
dike rank-orders. The conventional distribution of grades over a 
±3o normal distribution curve is, perhaps, as good as any. The 
data can then be tabulated as follows (A, B, C, D and F referring 
to grades and a, (Jf and < referring to precisely the same per- 
cental divisions in the descending rank-order arrangement of the 
Thorndike totals) : 
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The coilege Brades are expreaaecl as aigma values and each Fresh- 
man's rank-order is determined by finding his average aigma (the 
aum of his weighted sigmas divided by the number of unite car- 
ried). These average sigina values arranged In descending rank- 
order are then ready for comparison with the corresponding rank- 
orders in the Thorndike tests. If the Thorndike test is prognostic 
of academic ability then the 20 students composing the A group 
should have a rank -correspondence such as to place the majority of 
them in the a group (the 20 ranking highest in the Thorndike 
group). Tabulation II presents the rank-orders for college grades 
and Thorndike scores for comparison and analysis of the rank- 
correspondence in different percental regions of the rank-order 
series. The question is: Does the Thorndike Test performance 
anticipate the quality or approximate quality of college work a 
particular Freshman will do? 



TABULATION II. 
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The following observations may be made directly from the tab- 
ulated data: 

1. No. a's are ranked D or F in academic standing. 

2. No. ('s attain A or B standing. 

3. But of those making A standing, only 1/6 are a's and the 
largest number are drawn from the i group. 

4. Had superior scholarship been predicted by selecting the 
a group we would actually have secured 4 A students along with 
9 B students and 7 C students. 

6. 80 of the 157 students comprising the A and B groups are 
in the o and (J groups. 

Seventy-one of the 157 comprising the D and.F groups are in 
the 3 and e groups. 

That is, the upper 27. 5'/^ of the Thomdike rank-ordeni would 
have been somewhat selective as regards academic attainment. 
Had the c group been taken as a basis of entrance exclusion, it 
would have resulted in the excluding of 8 D students and 9 C 
students out of a total of 20 < students. 

6. Had the college wished to maintain very high standards and 
had excluded S and t standings, it would have excluded 79 C 
students, C B students, and 1 A student out of a total of 157 
Freshmen. The Thorndike ranking would have correctly placed 
71 (that is 8-t's who are in corresponding academic rank-orders, 
namely the D-F groups), while random choice alone would have 
correctly placed 44 of these. 

7. On the other hand, if the a-^^ groups had been used as a 
basis of initial retention in college, 86 D and F students would 
have been admitted into the Freshman class against the 71 D and 
F students excluded in the J-«'b exclusion. Chance alone would 
have given us 114 D and P grade Fj-eshmen, out of a total of 
410 0-^-7 's. 

Of the 569 students chance alone would have given 157 DF'a. 
Had the S-c groups been arbitrarily excluded (and the a-^--r 
groups retained), 71 D-F students would have been excluded and 
86 D-F included. But 86 A-B-C students would have been thus 
excluded. This would give a total of 176 improper inclusions and 
improper exclusions or 19 more than the improper inclnsions 
chance alone would have given. 

8. There are five comparable groups, o-A, ,3-B, t-C, )-D, and 
t-F. Of these groups, the 7-C is the only one that is largest for 
the column in question. In this case it is totally without prog- 
nostic significance as chance alone would have placed 116 C's in 
the 7 group. It should furthermore be noted that the distribution 
of C students through a, jS, >, y and < is about the. distribution 
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chance would have ^ven. And hkewise the row has a close-to- 
chance distribution through A, B, C, D and F. Hence for a stu- 
dent to be in the 7 group argues nothing as to his academic rank- 
order; and vice versa, C grades run the gamut of a near-chance 
distribution curve from a to «. 

Deducting from each of the five comparable groups (A-o, B-^, 
etc.) the number of cases that would fall in these groups by 
chance alone, gives the number of cases precisely located in a 
corresponding rank-order. We have: 



Of 20 fl's. 
Of 137 e's 
Of 255 >'s 
Of 137 8'a 



I A's or 15% in precise corresponding rank-order. 
27 B's or 19% in precise corresponding rank-order. 



: 15% in precise corresponding rank-order. 

Of 20 t's, 2 or 10% in precise corresponding rank-order. 

9. Compiling ff, 7 and 3 we have 529 cases, comprising 128 B's, 
246 C's, and 129 D's. Thus the Thorndike tests would have cor- 
rectly placed 12 more subjects than chance alone or about 2 per 
cent of the total number of students in the combined fl, 7 and e 
groups. 



TABULATION IIL 



^5^»^B5 


9 


2 





3 


5 


I 








j^ S»r*sB5to95 


5a 


ro 


Z 


n 


24 


7 


) 


4 


^ ScorasTOto 85 




^ 


6 


25 


92 


45 


23 


12 


^SweseOtoTD 


143 


29 





8 


33' 


37 


27 


18 


P Scores 50to 60 


96 


17 


1 


2 


18 


27 


34 


14 


^ Scares untor 50 


« 


:. 








M 


2G 


M 


15 



AN ANALYSIS OF THORNDIKE'S (iROUPINtiS 

Thorndike attempts to prophecy on a basis of the absolute 
scores received. He makes the following classification: 

"A boy scoring over 95 is worth admitting in almost entire dis- 
regard of technical deficiencies. 
A boy scoring 86 to 95 has intellect enough to do collegiate 
and professional work with distinction. 
A boy scoring TO to 86 has intellect enough to do the work to 
obtain a college degree. 
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A boy scoring 60 to 70 may be admitted if he is sufficiently 

in earnest and otherwise desirable. 
A boy scoring 60 to 60 should be admitted only if he is of 
extraordinary zeal or has suffered 
very great educational handicaps. 
A boy scoring under 50 should not be admitt«d." 
The accompanying tabulation (III) follows Thorndike's group- 
ing. The academic grade rank-orders have been arbitrarily 
classified to agree in rank correapondence with the Thorndike 
classification. 
Conclusions: 

1. None of the Thorndike A group falls in the corresponding 
academic group a (the 9 highest academic rank-orders); however, 
none falls in the lowest academic groups, e and f. 

2. Likewise none of the F group falls in the academic a or b 
groups. 

3. The students composing the a group came chiefly from the 
C group. 

4. Taking Thorndike's C group as the dividing line for in- 
clusion in or exclusion from college entrance, one would include 174 
correctly but also 93 incorrectly, (students making d, f, and e 
grades). On the other hand, the elimination of the D, E, and F 
Students would have excluded 93 students who are doing work 
in the a, b and c groups. Thus there would be 186 improper in- 
clusions and exclusions in using Thorndike's A, B and C groups ss 
an inclusion basis against 209 proper exclusions. Out of 669 
students 302 would be excluded. It must be recalled that in ex- 
cluding such a large percentage of the students seeking admission, 
chance alone would have correctly excluded 161. 

5. Excluding E's and F's would retain 85 of the upper 
Thorndike groups doing no better work than E's and F's, and 
would exclude 85 E's and F's doing work on a par with those 
admitted. Granting that e and f grade work warrants exclusion, 
we have 74 proper exclusions, and 170 improper inclusions and 
unjust exclusions. 

6. Let us take Thorndike's lowest group, F, (scores below 50), 
which Thorndike categorically asserts should be excluded. Of the 
63 comprising this group 48 do work on a par with many in the 
retained groups, while 48 in the retained groups are doing the 
same quality of academic work as those excluded. Thus we have 
96 improper exclusions and inclusions, and 15 proper exclusions. 

7. Tabulations II and III lead to the same general conclusions. 
While the corrclatiott hetirceii grades aiid Thorndike scores is 
reasoiiablj/ high, an impection of the differences in rank-order 
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correspondence ijtdicatea that great injustice would be done, both 
I'ji inc/iiewns and exclusions, were the entrance teats used as a 
basis of college admission. In acttial practice the lines of de- 
marcation between groupn are too illy defined to warrant sucK 
drastic action as off-hand exclusion from college. However, the 
trejtd of correlation is sufficiently strong to far surpass any im- 
pressionistie estimate and the tests should constitute an excellent 
basis for the initial analysis of eases, and for judicious use in 
ntlempting to size up Freshmen failures. Whether the mass teat 
is more truly prophetic of final college success than the combined 
estimates of dozens of instructors after seventeen weeks contact is 
a speculative matter which can be decided only by follow-up work 
for a number of years. 



IN BINKT TRSTS 

Forty of the upper rank-ordera of the Thorndike Test (Ito 58 
inclusive) and also 40 of the lower rank-orders (479 to 569 in- 
clusive)' were ^ven the Binet Tests.' The accompanying 
tabulation (III) shows clearly that the correspondence between the 
two teats is extremely close, quite in contrast to the vague cor- 
respondence between the Thomdike and the academic standinff. 

'loabllltj to acranse a time luICable for both the Btudeot and the ei- 
■mlDeT glTlDK tbe Bloet Teal, made tt Dtceisar; to so below rank 40 and 
above rank Sss Id tbe lower (roup. One of the lower rank-ordera waa 
elliDlnated. The aubject, an InteltlK^nt Italian Just learnlns the laOBUace. 
rafnaed Co try the BlneC Teat attei doing the Tocibalary. 

*The itudent appoint menE* tor tbe Binet Teata were arranged thronsh 
tbe co-operstlon of Profeaaor B. F. A«be, Freahman Advlaor. 
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TABULATION IV 

Binet Teats Uaed as a Ba^is for Comparing the Extreme Upper 

and Lower Rank Orders of Thorndike College 

Entrance Tests 

40 highest 39 lowest 

Rank Orders Rank Orders 

Ghronoloeical age range 22-8 to 16-5 27. to lS-2 

Chronological age median 20-1 18-6 

Mental age range 19-6 to 17-2 18 to 12-1 

Mental age median 19 16-6 

Vocabulary range J6,560 to 12,780 12,600to6340 

Vocabulary median 14,940 10^60 

Number failing 

XVIII Superior adult vocabulary 5 39 

Bi net's paper-cutting test 26 

Repeats 8 digits 13 24 

Repeats thought of passage... . 26 

Repeats 7 digits backward 12 31 

Ingenuity test .* 8 .31 

XVI Average adult vocabulary 30 

Interpretation of fables lb 

Difference between abstract 

words 11 

Problem of the enclosed boxes. 6 22 

Repeats 6 digits backwards 1 17 

Code 23 

XIV Vocabulary 50 words 8 

Induction test 7 

President and king 8 

Problems of fact. 10 

Arithmetical reasoning 9 

Clock 8 

XII Vocabulary 40 words 1 

Abstract words 

Ball and field i 

Dissected sentences 3 - 

Fables 1 

Repeats 5 digits backwards 8 

Pictures interpretation 1 

Gives similarities 1 

X Vocabulary 30 words 

Absurdities 1 

60 words 2 

Total No. of tests failed 44 361 
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The lower group is made up of older students and it may be 
added has more of foreign birth and foreign family. It is a 
matter of general observation that older persons show leas as- 
sociative plasticity and speed. 

Concerning I. Q. and mental age: 
8 of the lower group had I. Q.'a 100 or more. 
31 of the lower group had I. Q.'s less than 100. 

3 of the lower group had mental ages of 12(11-7 to 12-6) 
6 of the lower group had mental ages of 13(12-7 to 13-6) 

4 of the lower group had mental agea of 14(13-7 to 14-6) 
8 of the lower group had mental agea of 15(14-7 to 15-6) 

12 of the lower group had mental ages of 16(16-7 to 16-6) 
4 of the lower group had mental ages of 17(16-7 to 17-6) 
2 of the lower group had mental ages of 18(17-7 to 18-6) 

In the upper group the lowest I. Q. was 104. Nineteen failed 
in the high adult digits tests; 7 failed in both, 14 passed all of 
the tests; 13 failed 1 test; 11 failed 2 tests; 1 failed 3 tests; and 
1 failed 5 tests. 

The fact that 26 of the 44 failures in the upper group were digit 
tests indicates that the digit tests (counting an entire year of 
mental age) are entirely out of proportion to their importance in 
determining mental age. A careful study of the individual cases 
gives little evidence that immediate verbal auditory memory span 
for digits is of any marked value in determining superior intelli- 
gence. It ia a matter in which there is marked individual dif- 
ference in adults with slight reason for believing that there is a 
corresponding intellectual difference. i.}'- 

ReaSing and Vocabulary. The most striking contrasts be- 
tween the groups is in the vocabularies and redding habits. The 
highest vocabulary in the low group is les» than the poorest vocab- 
ulary of the high'group. 

An attempt was made to get at the reading habits of the 
groups under' consideration. A rough reading scale was impro- 
vised, scoring as follows: 

1. ^Readers of critical and dURoult lit^ature. 

2. Superior readers, read classical and good current literature. 

3. Average readers. 

4. Readers of newspapers and sport news. 

6. Readers who do almost no voluntary reading being nearly 
devoid of a reading habit. 
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Ajialysit of cases showing marked contratte in performance. 
It would have b«en highly desirable to have atudicd the social 
conditions surroundinK these Freshmen composing the upper and 
lower groups. This was impossible, due both to lack of time 
and to the diffidence on the part of students concerning their 
social and economic status. Nevertheless, after personal inter- 
views with the students in question, it is possible to throw some 
light on the marked inconsistencies in test performance and 
academic rank, presented in the accompanying Tabulation V. 

iroxcLrsi(ix« 

1. A high Thomdike rank is accompanied by a high Binet 
score and large vocabulary; and vice versa, a low Thorndike score 
by low mental age and small vocabulary. 

2. But high vocabularies are not necessarily found with a 
superior reading ranking or vice versa. 

3. Of the 40 in the upper Thorndike group, 14 are distinctly 
below any corresponding academic rank-order, while 7 fall below 
the median rank-order, 285, of the entire Freshman class. 

4. In the lower group just the opposite is found; with low 
mental age, low vocabulary and low entrance examination score is 
found a relatively high academic rank-order. Of the 10 cases, 9 
have academic ranks above the median rank-order of the Thorn- 
dike scores. 

G. The cases showing marked inconsistencies constitute nearly 
1-8 of the total mimber of the 79 eases studied intensively. 

6. It should also be noted that in spite of exceedingly low vo* 
cabulary and mental age, cases B2g, 6B8U, and 667 make more 
than median grades. 

T. In the lower group, 6 are either Italian or Jewish. In all 
of these eases, and many mc»% not presented here, the parents 
»pe«k a foreign language. Is it not to be expected that an English 
TOcabuluT and tests resting on the niceties of English idiom 
vlU suffer T 

8. Absence during the semester and a several-year gap be- 
tween high school and college seem to be the moat obvious and 
plausible explanations In certain cases of relative academic in- 
feriority in the upper group. 

-9. The pegTo, dase 667, unlike the Jewish and Italian tnan, 
apfteare very doll. He is eairying, however, a very heavy pro- 
gram including mathematics, physics and chemistry in which be 
1> maldngr more than median grades. An examination of the per- 
■entage of A's, B's, O's, D's and F's given in these courses indi- 
cates that they are not "pipe covses," (see T»bulatIon I). In the 
pplftiop of the writer the explapafclon is this: The student has 
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had an excellent high school training with a careful drilling in 
technical courses that dovetail into the courses taken in college. 
It is doubtful if the chap will long maintain an academic ranking 
of 167^ against a Thomdike rank of 667 and a Binet mental 
age of 12-2. 

10- The personal interviews elicited the following, at least 
plausible, explanations for the marked rank-order difference be- 
tween academic grades and the Thorndike tests: 

(a) Some students are capable but indifferent to grades, tend- 
ing to follow an interest ratber than make punctilious preparation 
of daily tasks. Case 8 is a good example. In the opinion of the 
writer, the Thorndike test places him more nearly correctly. The 
chap has been out of school three years between high school and 
college, which is perhaps a contributing factor, but the chief 
difficulty is that he has very positive ideas concerning academic 
values and refuses to fulfill, what he considers to be, petty class- 
room demands. He has already been successful in the work-a-day 

(b) Outside work, undoubtedly, in many cases makes for 
poorer grades. 

(c) Commuting tends, also, to produce a poorer grade of work 
than otherwise. 

<d) The character of the high school work plays a large part 
in the character of the Freshman college work. For example, one 
high school, gives to its seniors a course on Current Literature. 
All of these students show a relatively greater general informa- 
tion than the average high school graduate. Another high school 
apparently gives unusual work in science and mathematics. One 
of the students from the lower Thorndike group, with good grades, 
stated that the physics and mathematics he was taking were 
almost entirely review. Again, a student changing from a literary 
or a scientific course in high school to a- scientific or literary in 
college is greatly handicapped over the one who has had a con- 
stant vocational objective. All considered, students who have 
established good habits in mathematics, science, laboratory and 
English composition, regardless of their native endowment, have 
an advantage over those who have not. 

(e) Unusual zeal for learning and persistence mark the at- 
tttude of many of the foreigners, especially the Jews. The greater 
the economic and cultural handicap, .seemingly, the greater the 

(f) One might elaborate indefinitely, but this is suffi^ent to 
indicate that a careful study of tliie individual case is the next 
step after the rough grouping of a mass intelligence test. It i? 
much easier, and far more satisfying, to deal in broad statigUcal 
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trends than it is to tease oat the vexatious problems of individuml 
causes in variation. — r- But, the latter is the next logical step In 
testing. 

11. Errors in jading undoubtedly play a part in the rank- 
order differences between the Thorndike rating and the instructors 
rating. Impressionistic methods of grading, marked bias In 
weighting certain qualities in work and too few facts for estimate 
often cause the instructor's grade to be a long way from the 
absolute facta. 

CONCLUSIONS 

1. While there is a fairly high correlation between academic 
grades and the Thorndike tests, upon analysis the approximation 
is found to be too rough to permit exclusion, inclusion, or the 
assumption that the highest test group (above 95) is peculiarly 
superior. 

2. Neverthdess, the college entrance tests are not without 
merit, offering as they do, an initial point for analysis and 
judicious prognosis, but unfortunately, not scientific prophecy. 
Such tests are undoubtedly superior to any impressionistic esti- 
mates of the Freshman. It becomes necessary, however, to fol- 
low up the test findings with a careful analysis of the qualitative 
character of the score; to supplement with a common-sense in- 
vestigation of the nature of the high school training noting how 
well it dovetails into the curriculum of the particular student in 
question. The home, language, zeal, outside employment, and so 
on must be weighed and evaluated. The tests form but a part of 
a complex differential diagnosis. All factors must be carefully 
summated analogous to a court's getting a perspective on cir- 
cumstantial evidence. 

3. Whether the student is surpassing or falling below the 
Thorndike rank-order, he is equally of interest. At present such 
cases demand an investigation to "show cause." 

4. Not only is the Freshman up for critical study and evalua- 
tion but the test purporting to evaluate him is equally on trial to 
show it has value. 

5. A combination of Part I, form 5, and Part III, form D would 
probably be as valuable as all four forms; thus enacting a saving 
of 60 per cent in giving, scoring, and purchase price of blanks. 
But it should be added that for purposes of analysis, much is to 
be gleaned by a study of the qualitative character of all four 
forms. 
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6. The rank-order comparison between the Thomdike testa and 
the academic grades should be continued throughout the college 
.course. At present any aaaumption as to the superior prophetic 
value of the mass intelligence test over the Freshman's academic 
performance, is speculative and idle. 



THE UNRELIABILITY OF M. A. AND I. Q. BASED 

ON GROUP TESTS OF GENERAL 

MENTAL ABILITY.' 



By Arthur I. Gates 
Te&chers College, Columbia University 



The practice of computing mental agea and Intelligence 
Quotients from scores of group tests of general mental ability has 
been questioned recently on theoretical grounds," and various 
workers are discovering- the unreliability of these measures by 
comparing the results obtained from different tests.' This paper 
presents data which show that at least under certain conditions, 
quite ridiculous IQ's may be derived from certain group tests. 

The following tests were given on successive days to the pupils 
of Grades I to VIII inclusive of the Scarborough School: Dear- 
born, Kxamination I or II, Haggerty, Delta I or II, HoUeys Pic- 
ture Completion or Sentence Completion, Illinois (III to VIII 
only), Otis Primary or Advanced, National Intelligence, Forma A 
and B, (III to VIII only) and Meyers Mental Measure. The 
Stanford-Binet was given during the year to Grades I to VI 
inclusive. 

The tests were given to groups of twenty or less and particular 
attention was given to time, instructions, provision with pencils, 
etc. The pupils had learned to take tests earnestly and we are 
confident that the test conditions in general were more uniform 
and satisfactory than will be obtained in ordinary school practice. 
The results were scored by an expert. 

The mental age equivalents of the scores on the several tests 
were computed by use of the age norm tables accompanying each 
teat.' In most caseii the line describing the median age score was 
extended to cover such of our scores a^ exceeded the highest age 
norm given. From these data, IQ's were computed. 

Table I, which gives the data in detail for Grade I, illustrates 
the treatment of results. The horizontal lines give the facts for the 
several subjects; the vertical columns give the facts for the class. 
Columns 1 to 6 pive the IQ's which are summarized at the foot in 
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the form, (1) the highest IQ in the class (2) the lowest, (3) the 
mean and (4) the mean deviation from the mean. Column 7 gives 
the mean IQ for each subject; column 8 gives the mean deviation 
of the subject's various IQ's from his mean and column 9 gives the 
spread i. e., the subject's highest IQ minus his lowest IQ. These 
data are summarized at the foot of each column. 

The facta of Table I may be considered with reference to certain 
important school problems. 

1. Is the class, on the whole, composed of bright or average 
pupils? A very general answer .— bright — ■ may be given, but 
Ihe degree of brightness varies widely according to different 
tests. The mean IQ's range from 109 (Dearborn Examination) to 
129 (Myers). According to the one the group should do alightly 
better than average work, according to the other, very much bet- 
ter. According to the one the average pupil could scarcely com- 
plete a college course, according to the other ho could do so with 
ease. Assuming the average chronological age to be six years 
according to one test the mental age would be 6.5 years corre- 
sponding to first grade ability, but according to the other test the 
mental age would be 7.8 years corresponding to advanced Grade 
II work. • 

2. Are the pupils of uniform or diverse brightness? The 
figures for the lowest IQ are fairly uniform, ranging from 92 to 
99 but those for the highest are diverse, ranging from 121 to 165. 
The mean deviation of IQ's from the average are for the Dearborn 
G.O and for the Myers 12.3, with figures for the other testa scat- 
tering between these extremes. Recommendations concerning sec- 
tioning for purposes of promotion would depend very greatly on 
what test is used, 

3. What is the IQ of a particular pupil? Pupil A is given 
IQ's ranging from 104 to 165, that is, by one test he would be 
classified as "average" by another a "genius." Pupil A haa 
various IQ's ranging from 104 to 144. Column 9 gives the difTer- 
ence in points of IQ between the highest and lowest. The largest 
dilTerence is 61, the smallest 15, the mean 32. On the average a 
pupil ranges from "average" to "very superior" intelligence de- 
pending on the test. If we take as measures of variability the 
mean deviation from the average IQ instead of the whole range 
the figures given in column 9 are of course smaller the greatest 
being 17.0 the smallest 3.8, the mean 9.3. That is if the average 
IQ ia 118 in the average case half of the IQ's obtained from the 
several tests will fall between the limits 108.7 and 127.3. Further 
statistical treatment is unnecessary. It is obvious that the varia- 
bility of the IQ's obtained by several tests all given within a few 
days is so great as to make prediction concerning optimum rate 
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TABLE I 
Showing I .Q.'s Ortainbd by Pupils of Grade I in Several Tests 



11 11 'J I k I' I ii I 

ra5 (Sa OjS i kS SIS ' s£ « 

A 124. 104 135 124 126 144 126 9.0 40 

C 120.5 121 144 114 125 131 126 7.7 30 

D 114. 107 122 134 102 122 117 9.2 . 32 

E 135. 115 138 129 108 121 124 9.2 30 

P 110. 117 119 111 112 129 116 5.3 19 

G 133. 112 132 116 112 125 122 8.3 21 

R 92.5 99 119 105 120 115 109 9.5 28 

I 104. 107 140 116 111 135 119 12.5 36 

J 96. 99 117 104 107 152 113 14.8 56 

K 103. 92 98 98 107 99 100 3.8 15 

L 120. 115 131 127 114 1S6 124 7.5 22 

M 108. 108 125 100 09 123 111 9.2 26 

N 110. Ill 135 118 125 114 119 7.5 25 

O 104. 109 139 117 106 165 123 17.0 61 

P 121. 115 137 98 117.5 117.5 118 7.7 39 

Higheatl35. 121 144 134 125 165 126 17.0 61 

Lowest 92.5 92 98 98 99 99 100 3.8 15 

Mean 113. 109 129 114 113 129 118 9.2 32 

M. D. 10.1 6.0 7.6 8.9 6.8 12.3 5.4 2.2 9.6 

SIMMABV OF nKSlI.TS ¥OU (iUAUK II n^Ill. 

HightatUl 147 148 155 150 196 150 17.5 76 

LoWL-at 103 97 122 108 92 105 114 5.3 21 

Mean 117 116 132 135 124 135 127 10.0 35 

M. D. 7.4 7.3 6.9 12.4 12.6 15.4 7.6 2.8 10 



of promotion, possibility of completing college, etc. quite out of 
the question. 

RESULTS FOR GRADE II 

The results for Grade II are summarized in the lowest section of 
Table I. Tor this grade, the group teats, all of them non-verbal, 
are the same as those used in Grade I. 

The results are similar. The IQ's yielded by the Myers test 
show an average deviation from the mean which is more than 
twice that given by the Otis. One individual receives an IQ on one 
test which is 76 points higher than that given by another test; the 
difference between an averafre intelligence and idiocy. The 
average range of !Q for an individual is 36 points. 

RESULTS FOR GRADES III to VIII 

Table II gives summaries of the data for grades III to VIII. 
This Table shows the ridiculous results which teachers and other 
workers are likely to obtain from efforts to derive M. A.'s and 
IQ's from group tests in these grades. For example, one fairly 
bright boy in Grade VII earns a mental age of 46 years on one 
test giving an IQ of 408. If they should take the results of 
certain tests seriously there are many pupils who could think 
rather pitifully of Sir Francis Gallon whose IQ is estimated by 
Terman to be only about 200. According to the Myers test the 
average IQ's of our Grades VII and VIII is 2G1.' Picture the per- 
plexity of the teacher test enthusiast who finds that pupil K in 
Grade V earns an IQ of 99 on the National test and 36G on the 
Myers. Many others are nearly as baffling. 

The variability of scores obtained by a given individual be- 
comes, greater as the grade becomes higher, as may be seen in 
Table III which gives the range of IQ's and M. D.'s for the aver- 
age individual in each grade. 

These facts should not be interpreted lis a sweeping criticism 
of the usefulness and validity of group tests of general mental 
ability. What is urged is a restraint of certain inappropriate 
usus of these instruments. We should not, it is clear, compute 
M. A.'s and IQ's from raw scores, but thcst raw scores them- 
selves may be put to [irofitablo use. It lia.i been shown elsewhere that 
theso group tests at least those very verbal in coiitcjnt give sub- 
stantial correlations with achievement in rehool work." 

=lijs ninlil II..1 l.r (■..iiiMHiii f.T NiXIxniil uiiil iiiIk xiv.r.-* fur mtwt ..f 
iiiir <int<t>- VII mil) VIM unpll,^ Ihviiiiw lli-y cani'il siiirvx niPHlderubly 

hlulKT Miuii rliiiKi- ri'iiri-st'tili'd liy Ihc lliu- wlii-n tt lii'i.»iii.'S IicirliK I. 

.\. I. liHt<->. i'..ri'i'l;iil»iis .11' Itil.'lLiui'iKV li'>.rK with :i<-lii-v<'iii<'iit in m-hi»<l 
^iil.Jt-.;!.^. Jniiniiil <•!' i:(lilc'ilIU>ii:il I'syt'lii^louy. Mur.'li. A].rl[ uikI Miiy, 10-J2. 
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Highest IQ 133 127 133 136 147 171 154 166 143 16.8 76 

Lon-est IQ 95 Q4 90 106 100 93 80 90 98 4.6 16 

Mean IQ 112 112 109 120 120 120 U6 115 116 8.8 35 

H. D. from Mean 8.9 7.2 8.3 5.9 1Q.2 2Q.0 15.3 16.2 8.7 2.2 11 

CUADK IV 

Highest 140 133 142 399 166 176 162 174 154 61.0 292 

Lowest 99 100 104 93 113 104 100 104 113 6.0 15 

Mean 120 113 124 168 135 128 126 136 132 17.2 73 

M. D 7.1 6.1 5.5 61.4 12.4 11.0 10.614.010.8 10.2 52 

CRADF. V 

Highest 130 131 136 169 151 324 166 147 154 55.4 266 

Lowest 100 100 98 116 113 81 109 112 110 6.1 28 

Mean 116 113 120 139 134 169 132 133 132 19.4 88 

M. D. 9.5 7.3 10.0 13.5 9.2 79 13.9 7.3 12.3 11.7 69 

OIIADK VI 

Highest 160 141 170 162 164 351 191 152 180 49.3 218 

Lowest 83 88 80 92 95 70 92 97 90 4.8 14 

Mean 120 115 123 121 130 179 130 125 132 19.3 82 

M. D 18.8 12.9 20.2 16.9 16.5 75.6 20.6 13.0 21.8 11.9 55 

GUADK Vll 

Highest Not • 183 • 155 408 181 147 210 79.0 261 

Lowest Given 109 110 74 94 104 103 7.8 26 

Mean 137 132 261 138 127 159 43.9 14G 

M. D 14.2 18.0 96.2 17.3 9.2 19.0 24.4 77 

r.iiADK vtn 

Highest Not U8 ' 138 404 168 141 186 86.8 286 

Lowest Given 105 91 88 85 96 172 5.8 20 

Mean 124 116 261 124 111 147 46.9 157 

M. D 9.0 8.2 56.114.2 8.9 13.7 16.9 54 

"Scores for nearly all pupils above the equivalent of highest 
ages given. 
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TABLE III 

Range of IQ in the Mean Deviation from 
Several Tests for the Mean IQ for the Aver- 

Average Individual age Individual 

Grade I 32 9,2 

II 35 10.0 

III 35 8.8 

IV 73 17.2 

V 88 ■ 19.4 

VI 82 19.3 

VI 146 43.9 

VIII 157 46.9 

THE CAUSES OF THE UNRELIABILITY OF IQ'S BASED 
ON GROUP TESTS 

An effort has been madeto ascertain the causes of the extreme 
"variations in IQ given to the Hame individual by different tests 
although we probably have been unable to discover them all or to 
evaluate accurately those that seem likely. 

First, the distribution of native mental ability in the ^oups 
Ijpon which the testa were standardized has probably been un- 
equal. That this is often the case was clearly illustrated in con- 
structinE norms for the National Intelligence tests.' Such dif- 
ferences are not necessarily eliminated by mere accumulation of 
vast numbers of measures; a fact that is now quite generally 
recognised. It is probably an important source of inequality of 
the test norms. 

Secondly, the character of school training, especially in read- 
ing, writing and arithmetic, affects the results considerably. For 
example, if certain grades were backward in arithmetic in com- 
parison with pupils upon whom norms were established, they 
would obtain lower IQ's in those tests which contained relatively 
large amounts of arithmetical functions other things being equal. 

Again results will dilTer depending on the relative amounts of 
non-verbal material which the particular tests contain. Two in- 
vestigations have shown that in Grades III to VIII the correla- 
tions between verbal and non-verbal tests are low; sometimes 
negative in grade groups." In our results the association between 

■■i^v I.. M. IVniiuii ntul K. I). Wliltmln'. Akc niiil llriiil^ norinH for the 
NiiiUinut InlflllKvnpi' TcKtH. Jiiurnui of KduiutkinHl Hmi'ari^li. rt'liruacy. 
l!r.1. nnil (i. M. Whlmili-, TIip Niillonol IntPllisriiri^ TihIs. J.mrnnl of 
?:iliiciiti<iiiul Kiwarrli, lunr. UKtl. 

■J. 1>. lliTrio|[. Vi^l»l iinil BhKtract Pli-miiiilH In Intel! iRi^ncp fxRinlun- 
tiuDH. Juurnal liilumllonal l>ii]rclinluK]r. DiHTnihcr, 11121, and A. I. QatCB, 
auniu Journal, Marvb. Aiirll and Maj, 1022. 
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verbal and non-verbal tests becomes less close as the subjects 
become older. This fact is a partial explanation of the fact that 
the disagreement between IQ's is greater in the upper grades. 

The factor of greatest importance in our results is practice in 
group tests. Table II shows that Scarborough pupils earned IQ's 
that are obviously too high. On the whole, the more practice 
preceding a particular test, the higher the IQ's obtained. There 
i.s no doubt that practice results in very rapid improvement in 
such tests.' There are three ways in which practice will cause 
variations in IQ from teat to test; First, scores will advance con- 
siderably by virtue of general adaptation to test conditions; 
secondly, the gain will be relatively great in the particular tests 
which contain large amounts of identical or equivalent exercises; 
thirdly, the norms for the teats will be high or low, depending on 
previous practice in intelligence tests as well as on general mental 
abilities of the subjects on whom the norms were based. Do 
those who construct norms for their tests actually ascertain the 
amount, if any, of previous experience in tests their subjects have 
had? Without a doubt norms established on uninitiated pupils 
will differ considerably, native ability being equal, from those 
secured from pupils who have been tested extensively. 

Again, the cumulative procedure of establishing norms prob- 
ably tends in the long run to produce norms that are too low. 
Testers probably succeed in controlling the time better than other 
conditions. In the long run numbers of students fail entirely to 
understand methods of procedure, skip pages, lose time through 
distraction, broken pencils, etc., etc., whereas the factors conspir- 
ing for higher scores are fewer. Scarborough pupils were 
handled in small groups. They were provided with several 
pencils. They had learned to do their best in all "tests." Dis- 
turbances and misunderstandings very seldom occured. These 
factors would tend to produce differential success depending on 
whether a particular test contained more numerous speed or power 
exercises. Well practiced pupils would probably have a con- 
siderable advantage over the inexperienced particularly in the 
former, because they make a quicker start and maintain a steadier 
performance. 

Finally, most of the Scarborough pupils are of superior in- 
telligence as evidenced by the Stanford-Binet IQ's (which aver- 
age about 117'"), by achievement in school subjects and by informa- 



100 GATES 

tion concerning the social status of parents. It is possible that 
very bright children with a little practice may exceed average 
children in these tests by a larger amount than the IQ ratios 
would suggest. In support of this view we find that some of the 
very bright pupils very greatly exceed the norms for the grades 
to which their mental ages correspond in speed of reading. In 
depth or power of comprehension (Thorndike-McCall) however, 
their excess over the average, while 'marked, is not nearly so 
great. This would make for differential ?ucceas depending on the 
relative amount to which achievement in each of the several tests 
depends upon these abilities. 

It will not be profitable to speculate further; what we need is 
experimentation. These experiences have been sufficient to make 
one very cautious in the interpretation of group test scores and 
particularly cautious in the use of the M. A. or I. Q. 

The group tests are chiefly useful for purposes of rough 
classification and for very rough prediction but either should be 
undertaken only after inquiry into several factors. First, has this 
pupil ever taken such tests before? If so, which, when, and how 
many? We need data bodiy to enable us to make a rough correc- 
tion in such circumstances. Secondly, what has been the subject's 
training in school subjects? It was found, for example, that some 
of our Grade III pupils made enormous improvement in most 
verbal group tests as the result of having improved in reading 
during the interval between two tests. We need information con- 
cerning the transfer of improvement in all school subjects to 
achievement in group tests. Finally did the subject lose any time 
for any reason during the test? This matter assumes great im- 
portance in some of the group tests. If all of the pupils have had 
no (or the same amount of) previous practice in group intelli- 
gence tests if their school training has been the same and if no 
accidents occur the results, at least those of verbal tests, are 
very useful but coarse instruments for classification. 

Perhaps a change from the term "intelligence tests" to some 
such term as "classification tests" would have a favorable effect 
in reducing misunderstanding by teachers and laymen and in 
curbing misuse by over-zealous testers. It has been well said 
that the work of measurement "may soon need protection from 
over-extravagant hopes more than from hostile criticism."" 

"K. I,. Tli..rnaikf, Mva^urcmniit in E.liicHtlr.ii. Tlii> 'IVcmly-lirst Ywit- 
hnnk of (he Niitli>n[il Si.clHy Klu.ly i.f Kdnriili..ii. I'lirt I. p. K. Iifd2. 



NEWS AND COMMENT 

The Bureau of Vocational Guidance of Harvard Uni\'orsity has 
taken over the publication of ■ th-;- National Vocational Guidance 
Association Bulletin. It is their p-^/pose to enlarge and improve 
this Bulletin as support becomes assu'td for It. 

The Journal extends a cordial weleonii, ,t.> ihis new magazine in 
the field of vocational guidance. Profes:K>r Frederick J. Allen 
will serve us Editor, 



A NOTE ON POPULAR PSEUDO-PSYCHOLOGiC-VL. 
BELIEFS 

Kornhauser and Jackson present data in a recent issue of this 
journal' showing that actual business men do not use quack systems 
of judging character in their employment work. The results ob- 
tained by the use of their questionnaire arc rather surprising in 
view of the apparently successful exploitation of "applied psy- 
chology" by various chai'latans who invade our larger cities, ad- 
vertise extensively in the newspapers and on the bill boards, give 
free lectures in the best hotels or theatres and then conduct largo 
classes for four or six weeks at so much per head. Dr. Joseph 
Jastrow at Wisconsin has made a special study of these quacks 
and the writer believes as the result of conversations with Dr. 
Jastrow plus his own observations in the quack- infected North- 
west that the merits of psychological research and applications 
are imperiled by this wide spread exploitation of pseudo- 
psychology. 

Pseudo-phychological beliefs amounting in some cases to super- 
stitions seem to be more common than most of us realize. The 
writer in conducting a summer school course in Applied Psy- 
chology was amazed to discover the range of interests expressed 
by these adult summer school students, but even more so, by the 
beliefs shown in answer to a questionnaire. The range of inter- 
eats included a desire to study the problem of learning, memory, 
how to study, business psychology, salesmanship, influencing 
people, personnel work, personality, vocational guidance, ab- 
normal psychology, psycho-analysis, spiritualism and character 
analysis. Below is given a summary of the beliefs expressed by 
these students at the beginning of the course in answer to a 
questionnaire. 

The above table speaks for itself. If mature summer school 
students exhibit such a variety of beliefs what must the average 
business man believe? It goes without saying that such a course 

"A Qole ror lh<> « 
the Buslni-aii Wurlil 
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Positive Positive Unknown or 

Do you believe in: Belief Disbelief Uncertain 

1. Astrology ,.i...;.^.;,*. 2 11 7 

2. Chiropractic ...;,..."- 10 9 1 

3- Fortune TeUing 2 18 

4. Graphology ..; 5 5 10 

5. Hypnot^gm 12 8 

6. Memory Syatems 12 7 1 

7... Mental Telepathy 12 8 

, 8.*'. Spiritualism 5 15 

§. Palmistry ,. 1 18 1 

10. Phrenology 5 14 1 

11. Physiognomy 11 3 6 

12. Psycho-therapy 9 I 10 

13. Absent Treatment 1 12 7 

14. Gifted Children are "Peculiar" 12 8 

15. Psychology Can Determine 

What Specific Job a Man Is 

Best Fitted for 16 4 

needs devote some time and attention to evaluating the evidence 
for and against a large number of pseudo-psychological systems 
following this up with a presentation of what applied psychology 
can do and can not do. Thus it turns out that phychological in- 
struction must serve as a sobering survey of the limitations of 
psychological applications. It may be that business men are free 
from such false beliefs yet the undersigned classilieB himself as a 
"doubting Thomas." 

University of Minnesota Donald G.' Patterson. 
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rumBFiig, Edouard. Geneva, Suntzerland, Problems and 
Melhodi of Voeatioiud Guidattee. International Labor Office, 1922. 
Price, 40 cents. 

Interest in vocational guidance has been growing bo rapidly 
that the International Labor Office has taken cognizance of it as 
a subject of international importance. About two years ago the 
Office appointed the University of Geneva as its agent to collect 
information regarding the progress of the movement throughout 
the world, and to prepare news items for regular publication in the 
International Labor Review. This work has been carried on in 
increasing volume and with widening usefulness. In the meantime 
Professor Claparede has been conceiving and directing investiga- 
tions fundamental to vocational guidance from his laboratory and 
from the Institute J. J. Rousseau) and he has brought out this 
brochure as a precipitation of the results of his study. 

It is not a book. It ia rather a survey that just escapes the 
severities of outline presentation. Furthermore it does not treat 
all phases of vocational guidance. Though it recognizes the im- 
portance of the social, economic, physiological and educational 
aspect it treats specifically only the psychological. This it en- 
visages with great clearness. Particularly sane and proportion- 
ate is the critical discussion of the difficulties involved in the 
application of tests in practical vocational situations. In his 
summarized conclusions Professor Claparede gives what might 
be regarded as an international message: 

"In conclusion it may be well to summarize very briefly the 
steps which should be taken to place vocational guidance on a 
Arm foundation. 

1. Psychological analysis of occupations and their classification 
according to the abilities required. 

2. Determination of corresponding abilities in individuals and, 
as a preliminary, the testing of tests to determine their diag- 
nostic, and even more their prognostic, value. 

3. Investigation of the process of training and educability. 

4. Determination of the impottance of general intelligence in 
the various occupations. 

5. It should never be forgotten that a forecast of ability will 
never be a certainty, but only a probability. Statistics should be 
prepared to determine this probability. 

6. Efforts should be made to arrive at a uniform system of 
measurement so that psychographs or psychological diagrams 
may be comparable between diflferent countries and between dif- 
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ferent vocational guidance offices. Grading by percentiles appears 
to be the most rational and least ambiguous method. 

It is in the social interests of the community that every man 
should be in the position for which he is best fitted. It is also 
desirable and increasingly in accordance with the spirit of modern 
democracy that the various social functions should be allotted ac- 
cording to merit and not in virtue of any privilege. The only 
means of attaining this ideal is by a sound system of vocational 
guidance. All those who have at heart the harmonious organiza- 
tion of society, both employers' and worliers' organizations, should 
therefore fncilitate by all means in their power any investigation 
having for its object the establishment of industrial psychology 
upon a firmer foundation." 

Every American phychologist who is touching ever so lightly, 
either in his teaching or in his investigation, upon vocational prob- 
lems, should ponder on this brochure. He will find posed for him 
numerous problems for the experimental investigations so sorely 
needed, and he will find references to works of European investi- 
gators that are too little known in America. 

Indiana University H. D. KiTSON. 

PreSCOTT, F. C. The Poetic Mind. New York: The Macmillan 
Company, 1922. Pp. 308, $2.00. 

There are two classes of people to whom this book should be of 
special interest. The first are the psychologists. Professor PreB- 
cott has for the object of his study the working of the poet's mind. 
His evidence is from the most reliable source — namely, from the 
poets themselves. An English professor, he has collected from far 
and wide statements of the poets and other creative artists con- 
ccrning the source and manner of their inspiration; and with a 
surprising unanimity of opinion he has found that they testify to 
a power within from which their creative works emanate and over 
which they have no voluntary control. This mysterious source of 
power Professor Prescott attempts to identify with the subcon- 
scious mind. He seeks to show further, always depending for bis 
chief evidence on the poets themselves, that the same principles 
which apply to dreams according to Freud apply also to poems, 
which are emanations of the subconscious mind just as much as 
are nocturnal dreams. Poems, like dreoms, have their origin in 
thwarted desires. Step by step Professor Prescott parallels the 
two kinds of dreams, showing that the impulse, the censorship, 
displacements, condensations, fusions, and fictional gratification 
are common to both and have the same explanations. Whatever 
be tlie merits of his findings, he has decidedly done the psycholog- 
ists a service by bringing them into contact with a field of inveati* 
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gation which few of them are likely to be so well qualified as he 
to explore — the mental operations during poetic inspiration as 
explained by the poets themselves. 

The book, however, should perhaps have even a greater appeal 
to the critic and the student of literature. In the first place, even 
if there is not a particle of truth in his thesis, it is a fascinating 
romance of the subterranean caverns of the human mind. In the 
second place, if his thesis is partly true, his work becomes valua- 
ble and suggestive. It sheds new light on such ancient themes 
as the relation of beauty to truth, the catharsis of tragedy, the 
universality of the greatest poetry, symbuls and figures, and even 
puns. In the third place, it is very possible that his thesis is true. 
Once grant the existence of a subconscious mind of the kind ac- 
cepted by many modern phychologiata and the rest easily follows. 
The subconscious mind is old and wise, but not accessible to the _ 
average individual. The poet is one who for comparatively short 
intervals does have access to it, though through no volition of his 
own. What have been regarded as his vague and misty dreams 
are in reality flashes of truth from a deeper mind, which is racial, 
universal, unhampered by the limitations of time and space and 
immediate needs. Poetry, therefore, represents the hic-hcst wis- 
dom of the race. Scientists plod aloiitr, and by the aid of the 
conscious mind finally coiifirm what the poet saw i:i his vision. 
Shelley, without the aid of modern psychology, states the idea ex- 
actly in his Defeiine of Poetry: "In the infancy of the world, 
neither poets themselves nor their auditors are fully aware of the 
excellency of poetry: for it acts in a divine and unapprehended 
manner, beyond and above consciousness, and it is reserved for 
future generations to contemplate and measure the mighty cause 
and effect in all the strength and splendour of their union." 

It seems to me, however, that there is at least one rather serious 
inconsistency in the book. In Chaper VIII Professor Prescott is 
inclined to accept the conclusion of Wordsworth that emotions recol- 
lected in tranquility are "generally" the source of poetry. In 
Chapter XV he attempts to show that poetry is the result of 
thwarted desires: that, as the poet may not have the object of his 
desire, he seeks relief, even though it be a veiled relief, in a fic- 
tional gratification, as Keats, let us suy, in The Ei-e of Suint Agnes. 
Such a relief is obviously needed and obviously would come when 
the emotion is powerful and not when it is recollected in tran- 
quility. Likewise in the last chapter Professor Prescott has no 
b&Bis for even suggesting the possibility of poets for seeing spe- 
cific events in a literal sense, as Shelley foresaw his own death 
by drowning at sea. 

Ohio University. B. I.. Jefferson. 
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Tebby, Paul Washington, How Numerals Are Read. Chicago, 
The University of Chicago, Supplementary Educational Mono- 
graphs. No. 18, 1922. Pp. XIV+109. Price. Jl.OO. 

Part I of Doctor Terry's excellent monograph deals with studies 
of the reading of numerals by - introspective methods. Part II 
contains an account of the use of photographic apparatus in deal- 
ing with this problem. 

It is the opinion of the reviewer that the chief value of the mono- 
graph lies in the suggested method of studying the problem 
rather than in the results of the experiments, since a very limited 
number of subjects participated. Part II, involving the use of 
photographic apparatus, contains the records of six subjects; in 
Part I, the number of subjects ranges in the various experiments 
from four to ten. 
"^ In the first experiment, seven arithmetic problems were solved 
by ten graduate students who kept notes on their experiences while 
reoding the problems "with special reference to numerals." These 
observations were organized and recorded in a series of tables. 
The data made it possible to distinguish between a first reading 
and a re-reading in many instances as well as a partial and a 
whole first reading. 

Other experiments in which the method of introspective analysis 
was employed investigated the range of correct recall of numerals 
after the first reading, undertook an analysis of the re-reading of 
numerals in arithmetical problems and studied the successes of 
four subjects in reading numerals in columns. 

Important outcomes of the use of photographic apparatus are: 
"(a) The average number of digits included by a pause on' nu- 
merals is decidedly smaller than the average number of letters 
included by a pause on words, (b) The average duration of 
pauses on numerals is greater than the average duration of pauses 
on words in the cases of all subjects, (c) The percentage of re- 
gressive pauses on numerals is greater than the percentage of such 
pauses on words." 

The final chapter of the monograph contains very pertinent sug- 
gestions for teaching children to read arithmetic problems. Inas- 
much as the reading of numerals requires closer attention on the 
part of the reader than does the reading of words, it is suggested 
that during the first reading pupils be taught to devote their 
entire attention to the conditions of the problem, developing, at 
the same time, skill in the partial reading of the numerals. These 
conclusions are supported by the findings of Gray and Freeman 
in the field of reading. 

Ohio University. R. L. MoRTON. 
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Knight, Frederick B. Quaiities Related to Sueeeaa in Teaekinff. 
Teachers College, Columbia University Contributions to Educa- 
tion, No. 120, New York City. Pp. x+67. 

When and why is a teacher a successful teacher? Many at- 
tempts have been made to answer this question in terms of such 
general categories as personality, poise, physical qualities, mental 
qualities, moral qualities, disciplinary skill, instructional skill, etc. 
The list can be extended and subdivided almost indefinitely from 
one of the several score cards for teachers now on the market. 
The objection that can be made to the above descriptive terms is 
their generality. Although they are more useful than a "jfeneral 
impression" as a guide to getting a useable criterion of teacher 
success, more exact and less subjective measures would be wel- 
comed by the school administrator. The study here under discus- 
sion represents a contribution to scientific education in that it gives 
results and particularly an improved method of attack on this 
problem. 

The first chapter summarizes the studies of Meriam, Elliott, 
and Boyce in this field. Chapters II, III, and IV are concerned 
with the data of the author's investigation and the relative 
significance of the various traits and qualities studied. The last 
chapter gives a trenchant criticism of Boyee's study. 

The general procedure of the first part of the investigation 
was as follows. Ratings as to the relative teaching ability of 156 
grade and high school teachers in three different school systems 
were obtained. That is to say, the best teacher was ranked first, 
the next beat second, etc., when compared with all the other 
teachers of a given system. Three such rankings on the general 
ability to teach were secured from the supervisors, the teachers 
themselves, and a selected group of pupils respectively. By the 
method of correlation the validity of these rankings, and their 
relation to age, amount of experience, quality of handwriting, 
intelligence as measured by test, major academic interests, normal 
school scholarship, amount of professional study during active 
service, and ability to pass a professional test ("A Trade Test 
for Elementary School Teachers" by Knight and Franzen) was 
established. 

A few of the more significant conclusions may be given. 

"By using the coefficient of partial correlation we find, in the 
case of elementary school teachers, that, the factors of intelli- 
gence and normal school scholarship being constant, there is a 
mutual relationship of +.57 between ability to teach and ability 
to pass a professional test.... The amount of professional study 
accomplished during active service is also indicative of success in 
teaching. 



108 BOOK REVIEWS 

"In the case of high school teachers, intellectual differences, as 
measured by mental tests, appear to be significant. For the 
selection of high school teachers the use of mental tests would be 
of value. 

"These data, as a whole, may be interpreted to mean that the 
general factor of interest in one's work becomes the dominant 
factor in determining one's success in teaching... .other measur' 
able traits, either alone or in combinations, are not adequate ex- 
planations of teaching success. 

"This study indicates that age, experience, quality of handwrit- 
ing, intelligence as measured by tests, normal school standing, or 
the expressed interests of teachers are not closely related to suc- 
cess in teaching." 

In the second part of the study inter correlations were found 
among the traits teaching ability, ability to understand and man- 
age people, intellectual ability, ability to manage things and 
mechanisms, general scholarship, skill in government or discipline, 
instructional skill, initiative, nervous and physical strength, 
ability to command the respect of pupils and general ability to 
get results, the teachers rating each other on these qualities 
after the connotations of these terms had been explained to them. 
Concerning these data the author concludes that the factor of gen- 
eral spread of estimate operates to invalidate such ratings. That 
is, "when a judge attempts' to rate a teacher in some particular 
trait, his rating is a defense of his general estimate of that 
teacher, ius well as a rating of the trait under consideration." 

Doubtless the future will see a scientifically accurate and serv- 
iceable measure of teaching ability. The results and methods of 
such studies as this point the way to the solution of the problem. 

Colorado College Hermann Remm£R8. 

Wallin, J, E. W., The AekiefemtHt of Subnormal Children in 
Standardized Educational Tentn. Miami University Bulletin, 
Series XX, No. 7. $0.60. 

In this bulletin of ninety-seven pages. Dr. Wallin gives the 
results of some educational tests administered by special class 
teachers to about 300 St. Louis subnormal children. The tests 
used were the Ayers spelling scale, lists A to F and I, L and 0, 
and lists I and II in Starch's Spelling scale, Gray's oral reading 
and the spiral arithmetic excersises adapted from the Courtis tests. 

Dr. Wallin states that this "study should have a two-fold sig- 
nificance for educators interested in the study and training of 
feeble-minded and backward children : first, it is the only survey 
thus far made by several standardized educational testa of pupils 
enrolled in special schools for mental defectives; second, most 
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of the pupils tested had been psychotoKically examined and dif- 
ferentially dia^oeed, so that it is possible to analyze the results 
from the educational tests with reference to the children's in- 
telligence age, to their diagnostic classiflcation, such as imbeciles, 
morons, borderline, backward, visual aphasia cases, etc., and to 
the ^ade aaaigned them by the special class teachers." 

The results of the educational tests show that it is a waste of 
time and money to attempt academic instruction to low grrade 
children below four years mentality and that little reading can be 
accomplished by a child under the mental age of six years. On 
the other hand the tests show that subnormal children who may 
develop to about the nine-year mental level should be taken care 
of in the public schools and that although their training should 
a reasonable amount of time should be devoted to academic 
be along the lines of the monumental arts and proper social habits, 
branches. Dr. Walliu is convinced that it is of extreme im- 
portance to take every precaution in placing children in schools 
and institutions for the mentally defective and that their educa- 
tional attainment ability must be considered as well as a mental 
diagrnosis made. 

Ohio University. M. La Vinia Wakner. 

High Schools and Sex Education: A manual of suggestions on 
education as related to sex, Edited by Benjamin C. Gruenberg, 
Ph. D. Prepared under the direction of the Surgeon General, 
U. S. Public Health Service, in co-operation with the U. S. 
Bureau of Education. Washington, D. C, Government Printing 
Office, 1922. Pp. 98. Price $0.50. 

This is a very helpful and practical book for teachers of all 
young people of secondary school age. It makes clear the need 
of better methods of training in matters of sex. In the very 
earliest pages it differentiates sex education from sex informa- 
tion-~a point which the lay mind seems to have been slow in 
appreciating. Sex information without interpretation of its mean- 
ing to society and the individual and without inspiration to use 
it for the uplift of the race falls far short of its proper place in 
education. This little manual has been built up out of the accom- 
alated experience of thousands of teachers who have attempted to 
handle the delicate subject of sex. It outlines the necessary prepa- 
ration of teachers of sex education, discu.sses the type of person- 
ality necessary to make such teaching valuable and presents prac- 
tical methods and devices by which sex education may be accom- 
plished through the reRular courses in biology, general science, 
physiology, physical education, home economics, and the social sci- 
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ences. Numerous references are cited in order that the reader may 
have an adequate back^ound for more detailed reading. In the brief 
appendices ot the end of the book are some very valuable aag- 
Scations on the use of special lectures, exhibits, courses of study 
for teachers, personal hygiene and physical CKaminations. A very 
comprehensive bibliography of books dealing Avith sex and sex 
cdfication ends the book. As a manual of what is being done and 
can be done in sex education this book deserves a place in every 
teacher's library. 

Ohio University. G. H. GnoWDON. 

The World Book Company, Yonkers. N. Y., and 2123 Prairie 
Ave., Chicago. III., announces the following: 

1. Otis Setf-Adiiiinisterhig Tf»ts of Menial AbiUly, a new 
series of tests for grades from four to twelve and for college 
freshmen. The Higher Examination is for grades nine to twelve 
and college freshmen, the Intermediate for grades four to ei);ht. 
Experimental try-outs have been given in preliminary editions. 
Results have given high correlations with teachers' marks and 
estimates. Four new advantages, it is argued, arc to be had in 
these tests they are largely self -administering, very easily and 
quickly scored, afford a flexible time limit, and a wider variety of 
test material. There are two forms, A and B, each of equal 
difficulty. The Directions and Key with each package of 25, price 
$1.00 for Intermediate, $1.10 for Higher Examination. 

a. Phitner-Cuiiniiigkam I'limary Metital Test: This is a new 
in'oup test for the kindergarten, first and second grades and the 
only one on the market suitable for kindergarten pupils. It has 
been tried out in several previous editions. The advantage of 
a test applie.s to the kindergarten and primary grades are that 
it enables the teacher to classify beginners (with no previous 
school record), and also to discover by comparison of results, the 
degree of everlopping in mental ages. 

The examination consists entirely of pictures. No readin? or 
writing is necessary on the part of the pupils. The administering 
is sufficiently simple to require no special training on the part of 
the teacher. 

The examination booklets are sold in packages of twenty-five 
at $1.45 net per package. The postpaid price of a Specimen Set 
is 20 cents. One Manual of Directions, one Class Record, one 
Report to Author and Percentile Graph are included in each 
package. 

3. National Iiitelligfnce Testa, Supptemeiil No. S. The Com- 
mittee on National Intelligence Tests of the National Research 
Council has prepared Supplement No. 2 to the Manual of Direc- 
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tioiu for the tests. This supplement contains revised a^ norms, 
based i:pon the examinetion of 32,372 pupils in nineteen com- 
munities; composition of material for the a^ norms; data show- 
ing variability of the average mental ability of children from 
city to city; muntal age equivalent of scores; revised grade norms, 
with tables showing composition of the materials used, and a 

formula for finding IQ's and table for converting years iind 

months into months. 
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INTRODUCTION 

The facial expression portrayed in an advertising cut ia fre- 
quently an important factor in the sale. Efforts to portray "satis- 
faction" are quite common, and it is to this feeling that the present 
study is confined. 

Experiments upon the effectiveness of various types of adver- 
tising appeals have shown that this effectiveness varies with 
different commodities. This suggests that a similar relation may 
hold in the case of facial expression and that perhaps a satisfied 
expression in a cut may have quite different value in advertising 
different varieties of goods. It would seem, a priori, that certain 
purchases are serious and that pronounced satisfaction in the 
facial expression would be misplaced, while with other objects 
whose use normally provokes considerable satisfaction, such an 
expression would be desirable. It is probable that the advertiser 
sometimes errs in the use of such facial expressions. One notes, 
for instance, cuts of a man laughing moderately at a game of 
solitaire or smoking a choice cigar with marked solemnity. Per- 
haps this is correct or perhaps it is irrelevant but at least it sug- 
gests a problem. 

The following study is devoted mainly to the problem of whether 
the optimal degree of satisfaction portrayed in the facial expression 
of an advertisement varies with the commodity advertised. A sub- 
sidiary problem is whether the apparent satisfaction in the facial 
expression of a photograph corresponds to the actual satisfaction 
felt by the subject who posed for it, i. e., whether the picture act- 
ually conveys the feelings intended. 

It is impossible to approach such problems by strictly objective 
methods. The only possibility is to obtain observers' judgments as 
to how they would react to certain pictures with reference to the 
purchase of various commodities. Judgments of this sort are per- 
haps difficult and none too reliable but. with a sufficient number of 
observers and proper control of material and conditions, are un- 
doubtedly more valuable than a priori generalization. 
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MATERIAL. 

Two aets of material were used in the experiment. The first 
consisted of a series of bust photographs of the same male subject 
showing different facial expressions. Considerable preliminary 
worit was necessary in securing a subject who could pose properly. 
The set finally used consisted of six photographs that were taken 
in succession, with the subject in the same position. The lightinK, 
exposure and other technical aspects were constant. The subject 
posed in succession six increasing degrees of satisfaction startingr 
with slig-ht and ending with rather extreme. He was confident of 
the climactic effect and corroborated this by ranking the pictures 
subsequently. 

A set of these photographs was enlarged to 7x9 inches and each 
one mounted without margin under celluloid for daylight display. 
Contact prints 4x5 inches were mounted individually on white 
cardboard of suitable size for projection in a Balopticon. 

The other material consisted of 23 cuts of men's faces taken 
from current advertisements and portraying various degrees of ap- 
parent satisfaction. It was thought best to limit the faces to those 
of one sex thus avoiding an additional variable. The advertise- 
ments were trimmed so that none of the copy remained, and so that 
nothing in the cut suggested the kind of commodity advertised. It 
was impossible to control size but all the cuts were sufficiently large 
and sufficiently well printed to be seen without difficulty when pro- 
jected on the screen. Preliminary experiments served as a basis 
for selecting this final set of cuts from a somewhat larger number. 
The cuts were centered on white cardboard of suitable size for 
projection. 

For presenting the enlarged photographs a display board was 
used. This consisted merely of a medium gray cardboard about 
2x3 feet mounted on a light framework with the longest dimension 
horizontal. There was a narrow gray rack at the bottom of the 
card and the top ivas tilted slightly away from the observer so that 
the photograph could rest against the background. For the small 
photographs and the cuts a Balopticon was used to project them 
Upon a screen. A metal plate actuated by a spring held the card 
on which the picture was mounted in position and to change ma- 
terial it was necessary merely to depress the plate and insert 
another card. 

METHOD. 

Series I employed the enlarged photographs and the display 
Ijoard. The experiments were made in daylight with one observer 
at a time and all the results recorded by the experimenter. This 
series comprised three parts, which were given in succession. 

In Series lA the photographs were presented one at a time in 
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random <vder (different for each subject) with the instructions, 
"Describe fully the feolingrs which this picture sugKcsta to you." 
The complete introspection was recorded and subsequently an- 
alysed. 

In Series IB the observer was given the six photoerapha in a 
pile arranged in random order and was told : "These pictures were 
taken when the subject felt different degrees of satisfaction. Ar- 
range them in order with the one showing the most satisfaction on 
this end and the one showing the least satisfaction on this end." 
The observer's ranking was recorded in terms of the key letters on 
the backs of the photographs. 

In Series IC the photographs were again shown singly in ran- 
dom order with the instructions : "Name five commodities for 
which yoa think this pictnre would be effective in an advertisement. 
For which of these five would it be most effective, next most effec- 
tive, etc.?" The five commodities mentioned were recorded in order 
for each photograph. 

Series II practically repeated series I using the group method 
of experimentation. The treatment of results was identical. The 
smaller photographs were projected on the screen. The room was, 
of course, dark but could be illuminated sufficiently for writing by 
merely opening a door in the side of the Balopticon. The pictures 
were each given a key letter and presented in the same order in all 
three parts of the series. This order began and ended with mod- 
rate degrees of satisfaction and no two adjacent degrees occurred 
in succession. 

In Series IIA and Series IIC the instructions were identical with 
those of lA and tC. A picture was presented and its code letter 
given (verbally). After thirty seconds of darkness the room was 
illuminated for thirty seconds during which time the observers 
recorded their introspection on a blank. Another similar alterna- 
tion of darkness and illumination followed for the benefit of those 
who had not finished or who wished to note further aspects. A 
third alternation was given if requested by any observer. 

Series IIB involved ranking the photographs. Previous to the 
experiment the following six degrees of satisfaction had been 
writt«n on the blackboard, but the observers' attention not called 
to them until the proper time. 

1. Extremely satisfying. 

2. Very satisfying. 

3. Quite satisfying, 

4. Fairly satisfying. 
B. Slightly satisfying. 

6. Very slightly satisfying. 
The instructions were as follows: "These pictures were taken 
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■when the subject felt different decrees of satisfaction. These de- 
grees are as follows, (experimenter points to the list on board). 
You are to write down the six letters and the six numbers with 
tne proper letter. I will show the pictures in succession several 
times so that you can decide carefully." The photographs were 
then shown repeatedly in the same order and the code letter stated 
for each as it was shown. Each presentation was of fifteen sec- 
onds duration followed by a few seconds illumination. 

Series III employed the six small photo^apha and the twenty- 
three cuts in a group experiment. In the discussion of results 
the former will be designated IIIA and the latter IIIB. They were 
given, however, at one sitting with the photographs in a random 
order followed by the cuts in a random order. These series were 
concerned only with the problem of commodities and the judgments 
were controlled rather than spontaneous. It had been found that 
practically all the commodities mentioned spontaneously in aeries 
IC and lie could be summarized under ten classes (cf. infra, table 
II). Accordingly, a mimcogrraphed blank was provided with ruled 
columns headed with the names of these classes. Successive rows 
were likewise ruled and numbered at the left from 1 to 29. The 
blanks were distributed and the following instructions given. 
"This is an experiment upon facial expressions in relation to ad- 
vertising. I am going to show you a series of -pictures and in each 
esse you are to judge for what classes of commodities the picture 
would be effective in an advertisement. By effective is meant 
whether it would induce persons to buy the commodity in question. 
Confine your answers to the classes listed on the blank. After the 
number of the picture put a 1 in the -column to indicate the com- 
modity for which it would be most effective and 2 in the column to 
indicate second choice. You may mark other choices if you wish 
but always give at least two." 

A picture was presented and its number given. After fifteen 
seconds the room was illuminated for fifteen seconds, (all assist- 
ant operating the wall switch) for the observers to record their 
judgments. Another alternation of picture and illumination fol- 
lowed. The experimenter then queried, "All right?" and if there 
was no request for further repetition proceeded to the next pic- 
ture. There was no break between seriea IIIA and IIIB. 

The ranking of satisfaction portrayed in the photographs was 
obtained from the subject who posed. As this was impossible with 
the cuts, fifteen observers who did not participate in series III, 
ranked them. These observers were individually given the twenty- 
three cards and told to arrange them with the one showing the 
most satisfaction on the top of the pile and the one showing the 
least on the bottom and the intervening ones in order. The pile 
was returned to the experimenter who recorded the order. Then 
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the fifteen ranks given each picture were avera^d. There was some 
disagreement among the judges in their rankings of the various 
cuts. The mean variation of the fifteen ranks assigned to each 
picture was computed. The amallest of these mean variations is 
1.6, the largest 6.7, and the average 4.2. If two pictures in this 
series had each this mean variation of 4.2, the probable error of 
difference would be 1.3. So it would seem that a given picture was 
located at least within a few places of its correct position. 

The subjects were students — mostly undergraduates — ^in psychol- 
ogy classes at Ohio State University. Seriee I had 9 subjects, 
series //, 16, and series III, 67, The group experiments were con- 
ducted by the senior writer, (Burtt).' 
RESULTS. 

The minor problem above mentioned will be discussed first, viz., 
the correspondence of satisfaction actually felt with that apparent 
In the facial expression. Series IB and IIB give the most direct 
answer to this problem. For convenience in subsequent discussion 
the six photographs will be denoted by the letters U, V, W, X, Y, 
and Z, with U the one in which the subject who posed felt the 
least satisfaction, V the neict degree and so on up to Z the greatest 
satisfaction. The extent to which the observers' rankings of the 
six photographs correspond to this order of satisfaction felt by the 
subject is shown in Table I. 

TABLE I. 

AVIiUAGB KANK.S. 

Series U V W X Y Z 

IB ■ 5.8 4.7 4.4 2.6 2.2 1.2 

IIB 5.9 4.9 4.0 2.4 2.4 1.3 

Both 5.8 4.8 4.2 2.5 2.3 1.3 

The original ranks were tabluated with the six made by a given 
observer in a row. Then the columns were averaged to obtain the 
average rank assigned each photograph. These averages appear 
in table I, for series IB, IIB and both together. 

It is obvious that the observers judged quite accurately the 
satisfaction felt by the subject of the photographs. Considering 
the averages of both series the correlation is perfect. Moreover, 
the more detailed results show that all but three of the twenty-five 
subjects ranked U lowest and all but two ranked Z highest. The 
spontaneous descriptions of feelings suggested by the photographs 
indicate a rather climactic order from U to Z. 

This suggests Langfeld's" finding, — covering a wide range of 

^ Juurnnl of Abuorm. I-sych. IMS, 13, 1T2. 

emotions and attitudes hut not the one specifically studied in the 
present case, — of "uniformly good and consistent" judgments of 
emotions from facial expression. ' 

~'The wrllers nrc Indebted for same suggeittluiis iturLnK [he eurlk-r Biases 
of (he work to Dr. Harry W. Crane. 

'LoDKfelil, U. a.: The Judgntent of Einotlam from Fai-lal Etpiciiion. 
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The main problem of the experiment was the effectiveness of 
various de^ees of apparent satisfaction for advertising various 
commodities. The results will be considered in terms of the 10 - 
classes of commodities under which practically all the spontaneous 
judgments fell. The results for aeriet IC and IIC were (»nibined, 
as both used spontaneous reports on the same six photographs. A I 

preliminary tabulation was made to show the number of times each \ 

commodity was mentioned in connection with each picture. Sepa- « 

rate tables were made for first choices, second choices, etc., and ' 

total choices. Series HIA which involved the same material with 
controlled judgments was tabulated in the same way. Id series 
IIIB it did not seem worth while to evaluate each picture sepa- 
rately especially in view of the rather considerable disagreement 
amonj? the fifteen observers whose judgments provided the original 
rankings for satisfaction. To facilitate comparison with the other - 

series of six photographs the cuts were arbitrarily combined into ^ 
six groups on the basis of the average satisfaction rankings. Each .^r\ 
group comprised 4 cuts with the exception of the lowest satisfaction .^n 
group which comprised 3 cuts. The division was made in this way ~^W 
to avoid drawing the line between cuts with the same average ^^^x 
rank. A preliminary tabulation was made to show the number of "^U 
times each commodity was mentioned in connection with each of 'T 

these six groups of cuts. Separate tables were made for first B I 

choices, second choices and total choices. 

The results could now be considered from two standpoints. On.^E''^ 
the one hand it was possible to determine for each commodity what — VI 
proportion of the mentions were accorded to each picture or group «. ~r 
of pictures, i. e., what degree of satisfaction was most frequently ^rf 
selected as appropriate for a given commodity. On the other ^-"^ , 

it was possible to note for each picture or group of pictures what^^' 
proportion of the mentions were accorded to each commodity, i. e.^^na 
what commodities were most frequently selected as ones for whicb^^M 
a given degree of satisfaction would be appropriate. 

Table II presents the results from the former of the above stand 
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The original flgures were reduced to per cents to make the vari- 
ous aeries comparable. Only "total choices" are considered. First 
choices were tabulated separately but did not differ substantially 
from total choices and the latter were then selected because they 
involved a larger number of cases. The first column gives the 
classes of commodities, the second the series and the third the 
number of choices or mentions involved. The following six figures 
in a given row indicate the per cent of mentions for each of the 
six pictures or group of pictures. The headings U, V, W, etc., 
indicate increasing degrees of apparent satisfaction from U to Z; 
:tor series IC, IIC and IIIA they denote the six photographs, and for 
MIIB they denote groups of four cuts except that U involves only 
t^hree cuts. For example, of the thirty-three times indoor amuse- 
ments were mentioned in series IC and IIC, three per cent of these 
Knentions were for photograph U, three per cent for V, twelve 
per cent for W, etc; while of the 287 mentions of indoor amuse- 
STients in series UIB, three per cent were for U, twelve per cent for 
"V, thirty-one per cent for W, etc. Moreover, the average of the 
'ft:hree series as far as indoor amusements are concerned gives two 
per cent for U, thirteen per cent for V, etc. 

These same results are shown graphically in Figure 1. 
The ten sets of curves correspond to the ten blocks in Table II. 
Xn each set the different lines denote the three series and the aver- 
age of the three as shown in the key. The abscissae of the curves 
denote from left to right the six classes U, V, W, X, Y, Z, while 
the ordinates represent per cents. The total of the ordinates of 
each curve is, of course, 100 per cent. It should be noted in the 
figure and the table that the value for U in series lllB should be 
perhaps a trifle larger as it involves three pictures instead of four. 
The results are considered from the other aforementioned stand- 
point in Table III. 
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The first column f^ivea the picture or group of pictures and the 
next the series. The following columns in any row indicate the 
per cent of mentions for each of the ten commodities. For in- 
stance, with picture U in aeriea IC and IIC, 2 per cent of the 
observers selected indoor amusements as a commodity for which 
U would be suitable, 5 per cent selected automobiles, 40 per cent 
clothing, etc. 

Series IC and IIC involved about fifty total mentions, series 
IIIA about 130 and IIIB about 500, for each photograph or cut. 
Figure 1 and Table III show fairly consistent results with certain 
commodities but not with others. 

The curves for indoor amusements agree in starting low and 
they approach each other closely again at X. In Table III this 
commodity is seldom mentioned for U but more frequently there- 
after. Apparently slight satisfaction is undesirable while it is 
not clear whether moderate or greater degrees are most desirable. 

With outdoor amusements the case is clear. The curves show 
marked agreement with a minimum at U and a maximum at X. 
In the table for X, outdoor amusements stand next to the highest 
in averagre mentions. Evidently a rather marked but not extreme 
degree of satisfaction is the most desirable. 

It is impossible to draw any conclusion regarding automobiles 
because there is little agreement among the corves and the average 
curve is nearly level. 

The curves for clothing all start high and descend first abruptly ■ 
and then gradually, while in the table, picture U has a large pro- 
portion of mentions as suitable for clothing. Evidently, the slight- 
-est degrees of satisfaction used in the experiment were the most 
suitable for this commodity. 

Food shows a fair agreement in the curves, with a gradual rise 
toward the higher degrees of satisfaction. This relation is not as 
clearly manifest in the table, but on the whole it seems that a 
fairly high degree of satisfaction should be effective in food adver- 
tisements. 

The curves for photographs are rather similar to those for 
clothing and the tabular results also are similar. Apparently, the 
slight degrees of satisfaction should be most effective. 

The curves for publications are equivocal with a suggestion of 
A uniform rise at the end. This fact is not clearly borne out by 
the table. 

There is considerable discrepancy at the left in the curves for 
schools although the average trend is downward. The table is 
inconclusive. If there is any suggestion it is toward the effective- 
ness of the lesser degrees of satisfaction. 

Smoking supplies show a fairly consistent and gradual rise in 
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the curves. The table indicates frequent mention of this com- 
modity, for all the pictures except U. It would seem that any but 
the slight degrees of satisfaction would be desirable and perhapK 
there would be a slight gain in effectiveness as the satisfaction 
was increased. 

Toilet articles have a fairly consistent rise through the lesser 
degrees of satisfaction with little average change thereafter. In 
the table toilet articles are frequently mentioned for all pictures 
except the first. It seems that an average or greater degree of 
satisfaction should be effective in advertising such articles. 

The above results depend of course upon the judgments of an 
untrained, unaelected group of students. They may have judged 
in some instances by factors other than the one studied. Recogni- 
tion of a picture, fur instance, might sometimes affect the results. 
the conclusion that for clothing and photographs, advertisements —^ 
showing rather slight amounts of satisfaction should be more effec- — 
tive than those showing greater amounts, while for outdoor amuse- — 
ments, food, smoking supplies and toilet articles the moderate or— = 
high degrees of satisfaction should prove more effective. In the-^S 
case of outdoor amusements and food there is a further suggestion-^ 
that the satisfaction, if carried to the extreme, may lose somewhtLt-=^ 
in effectiveness. 

A further interesting problem would be to determine whether" ' 
current advertising seemed to follow the above principles or to-^" 
run counter to any of them. This would necessitate the collections^ 
of a large number of advertising cuts and their ranking by a- 
group of observers. A little evidence may be obtained by consid — 
ering the twenty-three cuts used in the present experiment in thv 
light of the commodities they had been originally used to advertise^ 
Table IV shows how the commodities originally advertised by the- 

TABLE IV. 

U V W X Y Z 

Indoor amusements 1 I 

Outdoor amusements 1 1 

Clothing 2 1 

Food 2 13 11! 

Smokers' supplies 1 

Toilet articles 12 2 

cuts used are distributed through the six degrees or groups of sat- 
isfaction. There were, of course, too few cuts for a given com- 
modity to permit much generalization, but clothing, for instance, 
occurs only in classes U and V which was shown above to be a 
desirable situation. Outdoor amusements avoid U and V as they 
ought to. Food, smoking supplies and toilet articles for the most 
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part occur in the hig-her degrees but have some instances in U and 
V which according to the above findings is undesirable. Without 
more data on this point it would be rash to criticize advertising: 
policies but the method just described if applied on & large scale 
'would doubtless be illuminating. 

The results of the main portion of the experiment are, of course, 
applicable only to the extent that the facial expression of a cut is 
a selling point in itself, i. e.. the apparent satisfaction of the user 
is supposed to be an inducement to the reader to buy. There are 
many occasions when there is some other leading selling point and 
the facial expression is one designed to emphasize it. In such a 
case, the foregoing results would be irrelevant. At any rate it 
seems clear that the advertiser should not always strive to portray 
a maximum satisfaction in facial expressions but that the optimal 
decree varies with different commodities. 
SUMMARY. 

The foregoing experiment employed photographs .posed by a sub- 
ject feeling different degrees of satisfaction, and cuts from current 
advertisements portraying apparently various degrees of satisfac- 
tion. Individual and group methods were used. The observers 
stated the feelings suggested by the pictures, ranked them for ap- 
parent satisfaction and gave the commodities for which they 
thought each picture would be most effective in an advertisement. 
The results were tabulated to show the correspondence between 
actual satisfaction felt by the subject posing for the photographs 
and apparent satisfaction judged by the observer. The correla- 
tion proved to be very high. 

The results were also treated in various ways to determine the 
optimal degree of apparent satisfaction for advertising different 
commodities. As far as the results go, the lesser degrees of satis- 
faction appear more suitable for advertising clothing and photo- 
graphs, while the moderate or high degrees are better for amuse- 
ments, food, smokers supplies and toilet articles. 

The results are, of course, irrelevant when the facial expression 
of satisfaction is not itself a selling point, but in cases where it is 
a selling point the conclusion may be drawn that it is undesirable 
to always strive for the utmost satisfaction but that the optimal 
amount depends on the kind of commodity advertised. 



COMPARATIVE SOCIAL TRAITS OF VARIOUS 
RACES, SECOND STUDY 

By C. B. Davenport and Laura C, Craytor. 



In "School and Society" for October 22, 1921, one of us published' 
a study of "Comparative Social Traits of Various Races." This 
study was based on only 51 individuals and was confessedly frag- 
mentary. It was published in the hope that it would stiinulat« 
Others to make similar studies. How far this hope has been real- 
ized ne can not say, but at least the first paper doubtless made it 
easier to secure cooperation of other teachers in collecting such 
data. The present study is doe to the interest taken by Dr. R, S, 
Benedict of the Stuyvesant High School, who undertook to secure 
additional data from his pupils and to whom we are greatly in* 
debted. These have doubled our totals. Since the latter are exclu- 
sively for boys, while the earlier were exclusively for girls it has 
seemed useful to combine the two collections to get results that 
may be expected to hold for the papulation as a whale. A compari- 
son of the sexes is hardly possible with the small numbers available. - 

As stated in the earlier paper the purpose of the study is to 
replace opinion as to race differences in social traits by quantita- 
tive estimates. 

The method is exactly the same in the two studies. The inde- 
pendent judgments of one to three teachers were obtained con- 
cerning ten traits of each pupil, using the graphic rating scale of 
the Scott Company, Philadelphia ("School and Society" XIV, p. 
345). The data were tabulated and appraised as stated in the 
earlier paper. Probable errors have been calculated in order that 
the significance of the differences may be made clearer.' The re- 
suits are tentative. It is hoped that this paper may stimulate to 
further studies of this subject. 

RESULTS. 

Altogether 188 sets of judgments were rendered on 102 persons, 
as follows: 20 on 10 Germans; 15 on 9 Irish; 37 on 22 Italians; 
59 an 31 Austrians, and 57 on 30 Russians, also 116 on 61 Jews, 
being the sum of the Austrians and Russians, just listed. 

There were calculated for each of these nationalities the mean 
of the judgments for each trait and the probable error of the 
mean. These means and probable errors arc given in Table I. 
Thus under Germany, Leadership, we find the mean of the 20 
estimates made on 10 persons to be 59.7±3.0. This means that the 
position of students of German stock, in respect to leadership, was 
on the average slightly above mediocrity, or 50%, There ia, how- 
ever, an even chance that the true value (theoretically based on an 
infinite number) is only equally apt to occur within the range; 
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56.7— G2.7 aa outside that ran^. It is usually held that differ- 
ences between two means which are greater than three timea the 
square rctot of the sum of the probable errors of the means is cer- 
tainly a significant difference ; that it depends not merely upon 
small numbers, but upon a real difference in the "set" of these 
numbers. For example, while the mean of 20 estimates concern- 
ins leadership of students from Germany is 59.7±3.0, that of 15 
estimates of students born in Ireland is 38.3=t5.0. There is, thus, 
a difference of 21.5 in the mean of the judgments for the two 
countries. The square root of the sum of the squares of the prob- 
able errors is 5.8. Three times 5.8 is 17.4 which ia less than the 
difference of the means; hence the difference between the means is 
probably a biologically significant one. Even with the probable 
errors the "conclusions" must be held to be merely tentative; for 
the "probable error" has not the significance with small numbers- 
that it has with large numbers. 
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In Table I the means and probable errors are given for 6ve 
nationalities, namely, pupils who came, or whose ancestors came, 
from Germany, Ireland, Italy, Austria and Kussia. The students 
of Austrian and Russian stock in this New York City school are 
almost exclusively Jews. It seemed worth while to combine those 
from Austria and Russia under the heading of "Jews", and these 
results are gi^en in column 6. Table I then should give us some 
sort of an answer, though imperfect, to the inquiry with which 
we started as to the difference in social traits of persona of differ- 
ent nationalities. 

CONCLUSIONS. 

While numbers are still insufficient to form final conclusions, the 
results suggest the following tentative conclusions. 

In leaderskip the German children stand first at 59.7±3.0 point' 
quite markedly above the others. The difference between this mea 
and that of the Jews ia less than three times the probable erroi 
Nevertheless the Jews may be considered as a race characterize 
by a medium leadership. On the other hand, the Irish and Italian 
are characterized by a low standard in leadership, and the dif- 
ference between them and the middle group is, doubtless, signtfl- 

In pertinacity the Germans stand first. This group is probably 
higher in respect to pertinacity than the Jews. The Irish and 
Italians stand lowest in this respect. 

In humor, the German children stand first <62) and the Irish 
stand second. However, the difference between these two nation- 
alities is not great and, indeed, not to be differentiated from the 
Anstrians and the Jews in general. Between this group and the 
Italians there is probably a real difference in respect to national 
humor. 

In frankness the German children again stand first (57) and the 
Jews, and especially the Austrians, are a close second. The Irish 
and Italians fell into a slightly lower class. 

In suspiciousness, Jews and Irish stand above the others. Prob- 
ably the Italians are not significantly lower. The Germans, how- 
ever, are probably least in this respect and certainly are quite 
distinct from the Jews. 

In eympatky the Germans stand highest, the Jews and Italians 
may be included in the medium category. The Irish are least in 
this respect. 

In loyalty, the Germans stand highest, but in the same category 
are aiso the Italians and Irish. The Jews occupy a lower position. 

In generosity the Germans, Italians, Irish and Jews stand at 
nearly the same level. 

In ohtriisivenesB the 61 Jews stand at the top (52) and seem to 
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form a class distinct from the Germans, Irish and Italians which 
form a middle or lower group. 

In coolneaa the Germans and Irish stand easily first (86). In a 
significantly lower group stand the Italians and Jews. 

The 10 Germans stand at, or near the top in Leadership, Perti- 
nacity, Humor, Frankness, Sympathy, and Loyalty, more than half 
the traits. They occupy a relatively low position in Suspiciousness. 

The 9 Irish fall in the upper group in respect to Humor, Suspi- 
ciousness, Loyalty and Generosity, and in the lowest group in re- 
spect to Leadership, Pertinacity, Frankness and Sympathy. 

The 22 Italians stand in the upper group in regard to Loyalty 
and Generosity and lowest in regard to Leadership and Humor. 

The 61 Jewish children stand in the first group in Humor, Suspi- 
ciousness, Generosity, and Obtrusiveness and in the medium group 
for the other traits. 

In addition to the mean values of the social traits for the differ- 
ent nationalities, there is a difference in the variability of judg- 
ments of persons from different countries, and it has seemed worth 
while to consider this variation. Accordingly, the standard devia- 
tions of the judgments for each nationality and trait are given in 
Table III. The probable errors have also been calculated as a 
means of judgment of significance, or rather, lack of significance 
of the difference of these indices of variability. Thus, from Table 
III, it appears that the variability in the judgments on Leadership 
is greatest for the Jews the standard deviation being 28.1±1.3. It 
is least for the Germans, 20.0±2.1. Although the difference may 
not be a significant one, there is a suggestion that the Jews (as 
represented in our statistics) include strains that vary more from 
each other in Leadership than in the case of the Germans. 

On the other hand in Pertinacity, the Italians showed themselves 
the most variable and the Irish the least, although the difference, 
even in this case, is less than three times the probable error. 
Again in Humor the variability in judgments rendered on Italians, 
Jews and Irish are high, and for Germans somewhat lower. One 
of the striking differences in Table III is the slight variability of 
the Germans in regard to Coolness (15.2), a trait in which they 
stand at the top, and the variability of the Jews in this trait 
(22.8), a trait in which they stand at the bottom. Taking the 
average of the standard deviations of the ten traits for each of 
the nationalities, we find that the variation is greatest in the Jews, 
(21.8) and next in order in the Italians and Irish and least in the 
Germans. 

From another standpoint it is interesting to compare the varia- 
bility of the different traits for all nationalities. This average has 
been entered in the right hand column of Table HI. The order of. 
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the BVersK^ variation for these ten traits is as follows: Leader- 
ship — ^26.5, Humor— 25.6, Pertinacity — 23.2, Frankness — 21,6, 
Coolness— 20.7, Obtrusiveness— 20.4, Sympathy — 18.2, Suapicioua- 
ness — 17.7, Generosity — 16.2, Loyalty — 14.2. 

The interpretation of the differences in averBgea of the teir. 
traits is not eaay. It may indicate a difference in the intrinsic 
variabUty of the traits or a difference in the ease or certainty of 
estimating them. One sees no inherent reason why it should be' 
easier for teachers to estimate Loyalty of pupils than to estimate 
capacity for Leadership. It seems to me more probable that Loy*- 
alty is a trait in which students (in their teachers' opinions) stand 
uniformly rather high, and that Leadership is a quality in which 
they show great diversity. 

'Dr. J. Arthur Horris pnlln my ntlenllon to Ihe fnct thnt the probable 
errors nnd the Hlandonl itovlntlona uiion ivlitch (her ore based are probab" 
InHiivncvd, to aome extent, by the fnct thnt lillTi-rent leuehera rated t 
diRercDt ladirldnitlfl ; and one at'I of tenchera ralMl a larger proportion 
tbe German stuitenlH than another aet which treated, any, a tnrfrer propc 
tiun i.f the Irlah, Thun any dirTerenee In the personnf ecjunlion of Ihew 
two grimpa of rnlera would be reflected In the mngnitude of the Turlabll- 
Itlea. RepresenlutlveB of the different raeeB B*ere. of coura. ■■ ■- - 

the d^erent piilm of rnlcrs did not rute 
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A CONTRIBUTION TO THE TECHNIQUE OF 
PARTIAL CORRELATION 



By C. L. Huffaker 
State University of Iowa 



It ia well recognized that the partial regression equation is the 
best tool for the study of many educational problems. This is 
particularly true if the problem involves (1) the analysis of a 
"general ability" into its component specific abilities, or (2) the 
. determination of the diagnostic value of different tests. In the 
schema developed by Yule' the computation becomes very compli- 
cated and laborious if the number of variables is at all numerous. 
Methods of shortening the labor have been devised by Kelley" and 
Rosenow'. The schema devised fay Rosenow requires only about 
half the lafaor of that of Kelley, but it has the very important 
shortcoming that the signs of all but two of the highest order 
coefficients are indeterminate. It necessarily follows that the 
signs of all the regression coefficients are indeterminate except 
two. This shortcoming imposes a serious limitation on the use- 
fulness of Rosenow's schema. Both plans referred to above, make 
use of the fact, that usually the solution of such problems as have 
been indicated before requires only one regression equation. 

The writer has devised a schema for solving problems in partial 
regression which involves the finding of fewer coefficients than 
either of the two plans cited before and at the same time avoids 
the approximation of Kelley's plan and the indeterminate signs of 
Rosenow's plan. 

NUMBER OF COEFFICIENTS REQUIRED* 

Variables This plan Yule Kelley Rosenow 

Par. Mul. Par. Mul. Par. Mul. Par. Hul. 



5 22 2 61 1 36 1 22 4 

6 46 2 240 78 1 45 6 
This plan is outlined below. In the outline it is assumed that 

the reader has a working knowledge of the theory of correlation 
and of the notations of partial correlations as given by Yule. 

The general problem before us is: given a dependent variable 
and a number of independent variables how can the maximum of 
information be obtained with the minimum of arithmetic? This 
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problem may be divided into two sub-problems which are aucces- 
aive stages of a single operation. The two stages are: (1) The 
finding of the coefficients of partial correlation, with reference to 
the dependent variable, of the highest order; (2) The finding of 
the coefficients of regression (weights) for estimating the depend- 
ent variable. 

In a problem involving four variables, the tables given below 
include all the partial correlation coefficients of all orders needed 
for finding the coefficients of the highest order with reference to 
the dependent variable. 

FlrBt_itrdeT Haj b« obtained rram 



CoefficleDts 
1Z.1 



Zeru Order 



14 



24 



n to be used in estimating the dependent 

X +1) X +b X 

^ x^34 2 1^.34 3 14.23 4 

In which Xi is the estimated deviation from the mean of variable 
1 ; Xi observed deviation from the mean of variable 2 etc. 

In addition to the coefficients given above the four standard de- 
viations of the type 01.234 will be needed. Each of these may be 
found in three different ways, for example '1.234 may be found 

1.2Si 1 12 13.2 14.23 



-,"-'„"■■'. 



13.4 



)(l-r 



12.34 



"*"l 13 14.3 12.34 

It is now possible to select formulae for the standard deviations 
needed in sach a way that all the coefficients used occur in the 
tables of partial coefficients given above. The formulae selected 
in this case are; _^2 =J^ii.^ )(i-r^ Xi-r^ ) 

1.234 1 12 13.2 14.23 



, =»„"■'■ 



3.134 



24 



)(l-r 



Hl-r 



12.34 



39 
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Second Order 

Coefficients 

Needed 


First Order Coefficients 


'12.45 


'12.5 


^4.5 


'24.5 


'lSA5 


'13.5 


'14.5 


'34.5 


'l4.28 


'14.2 


'l3.2 


'34.2 


'15^8 


'15.2 


'13.2 


'35.2 


'23.45 


'23.5 


'24.5 


34.5 


'45.23 


'45.2 


3B.2 


'34.2 


Third Order 

Coefficients 

Needed 


May be obtained from 
Second Order Coefficients 


'12.345 


'12.45 


'13.45 


'23.45 


'13.245 


'13.45 


'12.45 


'23.45 


'14.235 


'l4.23 


'l5.23 


'45.23 


'15.234 


'l5.23 


'l4.23 


'45.23 


The formulae for the standard deviations are: 





12 13.2 14.23 1S.231 



4^.23 1S.234 



_ (rl,2.'!45 

L2.340~ 12.345 (r2.134o 

_ al-234j 

3.215~ 1.1.245 ir3.12Jo 

etc. 
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rbe equation for six variables is: 

X =b X +b X +b X +b X .b X 

1 12.34i)n S 13.243U 3 14.335a 4 13.23K} 10.2343 S 

rhe plan for six variables is given below and ia subject to tbe 
rne checks as the problems witb a smaller number of variables. 



Fist Order 

Coefficients 

Needed 



May be obtained from 
2ero Order Coefficients 



13.2 
'l3.6 
"^14.2 
'l4.6 

15.2 
'l5.6 
'l6.2 
"^23.6 
'24.6 
'25.6 
'34.2 
'34.6 



46.2 

'45.6 

%6.2 

'56.2 
Second Order 
Coefficients 
Needed 

"^12.66 

'l3.56 



12.6 
'13.6 
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14.23 

'l4.66 
'l5.23 
16.23 
^28.66 
'^24.56 
'84.Sfi 
'45.23 



Third Order 

Coefficients 

Needed 

'12.366 
12.466 
'l3.466 
'l4.366 
'l6:a34 
'16.234 
'23.466 
'24.356 
'56.234 
Fourth Order 
Coeflkients 
Needed 

'12.3456 
'18.2466 
'14.2866 
'l6.2846 
'lS.2346 



14.2 


13.2 


34.2 


'14.6 


'15.6 


'45.6 


'15.2 


'13.2 


'35.Z 


'16.2 


'13.2 


'36.2 


'23.6 


'25.6 


'35.6 


'24.6 


'25.6 


'45.6 


'34.6 


'45.6 


'3S.6 


'45.2 


'35.2 


'34.2 


'46.2 


'34.2 


'36.2 


'56.2 


'35.2 


'36.2 



Msy'be obtained from 
Second Order Coefficients 



12.66 


13.66 


23.66 


'12.66 


'14.66 


'24.66 


'l3.56 


'l4.56 


'34.56 


'l4.56 


'l3.56 


'34.66 


':5.23 


'l4.23 


'45.23 


'16.23 


'14.23 


'46.23 


'23.66 


'24.66 


'S4.56 


'24.56 


'23.66 


'34.66 


56.23 


'45.23 


'46.2a 



May be obtained from 
Third Order Coefficients 



12.456 13.456 23.456^ 

13.456 12.456 '23.45ff 

'l4.356 'l2.356 '24.366 

15.234 'l6.234 '66.234 

16.234 '16.234 '66.234 
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Formulae for standard deviations. 



4.123Sa 
2 

5.1S3W 



«'"'V,. 


)(l-r' )(l-r" 

UM l»,45'l 


(1 


12,343 


MJ " jl3. 


Kl-r )(l-r" 

24,50 a3.400 


(I 

(1 


12.3450 * 
13.2450 


''«■ 


"'i.»,"'L„ 


(1 


14.2350 


V*'".^. 


)(l-r Kl-r' 

45.23 nil.234 


(1 


15.2340 


M) ''30, 


*'^'40.23** '50.234 


(1 


16.2345 


3 are: 


ffl.234.-,0 






'l2.345C~ 


12.3450 <r2.]3-15i; 








(rI.234,Vl 






13.215fl~ 


13.2450 D3.124W 







Formulae for the b' 



etc. 

The same plan of selection can be used for any number of vari- 
ables with the same proportionate saving of labor. The use of 
Kelley's Chart referred to before is possible with four variables, 
but is not recommended for more than that number. For five and 
sin variables the writer recommends the use of such tables as 
Miner's' and a calculating machine. By the use of these tables and 
a calculating machine it is possible to solve a problem of six 
Tariables correct to four places in three hours, after the Zero Order 
Coefficients have been found. 
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THE RELATION BETWEEN THE INTELLIGENCE; 

AND VOCATIONAL CHOICES OF HIGH 

SCHOOL PUPILS 



By GUSTAVE A. Feingold 
Hartford Public High School. 

In the varied literature on vocational guidance and vocational 
education, one finds that almost nothing has been done in the at- 
tempt to correlate the vocational choices of high school pupils with 
their mentality.' Yet if vocational guidance ie to be put on k 
scientific as well as practical basis, this is the very first thing tfamt 
should be done. The chief function of the vocational adviser in the 
high school should be to save pupils of high mental ability from 
entering occupations of limited opportunity, on the one hand, and to 
advise others of little ability against trying to enter occupatdons- 
for which they have not the intellectual foundation, on the other 
hand. 

In the September 2, 1922, issue of School and Society there ap- 
pears an article on Occupational-Intelligence-Standards' wherein i» 
presented an intelligence scale grouping some ninety-six different 
occupations into various Army Alpha scores, based on the results 
of the occupational studies made by the Division of Psychotosy, 
S. G. 0.; and reported in the now famous Volume XV, Memoirs of 
National Academy of Sciences. 

With this Occupational-Intelligence Scale before ua, there was at 
hand a means for comparing the vocational choices of high school 
pupils with their intelligence grades, in order to determine whether 
they overrated or underrated their abilities, and to what extent. 

All occupational-intelligence scales ere based on the assumption 
that certain vocations are within reach of certain mental levels. 
One group of vocations is within reach of "A" intelligence, another 
within reach of "0" intelligence, and so forth. If a high school 
pupil of a certain mental level, "D," let us say, desires to enter ■ 
vocation which belongs to a much higher level, like "B", he over- 
estimates his ability by two degrees. The assumption is that he 
will either not succeed in entering his desired vocation, or if he 
does, the probability is that he will not be efHcient in it. On ths 
other hand, if a boy expects to enter an occupation that belongs to 
a much lower mental level than his own, the community loses bf 
that choice, inasmuch as it does not get from him the best and 

'In tbe IS3 titles nnrftc Ptwl^nlouy nf Ywallimal HclccUnn reviewed by ». 
W. KrohnliiiuHor. INy. Bull. Vi.l. ]tt, No. 4, 1D22. not one ueemi to deal ■»•- 
plll™lly Willi llie abuve pcoblenl. 

'DouglflH Frjer, Ocouputiinal-IiileUigeace Elanitaria, School and BocMTf 
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utmost service that he is capable of rendering, nor will he be happy 
because he will not have the full opportunity to express hia entire 
personality in it. This is an important matter, for about 50 per 
cent of all high school pupils make up their minds with respect to 
their future calling even before they enter school, and about 80 
per cent of these cling to their original choice throughout their 
school career. Our problem, therefore, was to find out to what 
extent high school pupils make or express vocational choices that 
are within reach of their mentality. 

To be sure, the alpha scores given for the various occupational 
groups in Fryer's table were attained by individuals whose school- 
ing, for the moat part, lay from five to fifteen years behind them; 
and, in view of the fact that when the youth gets out of school 
he is bound, more or less, to get into a rut of thinking and acting, 
it is inevitable that he should strike a lower score in an intelli- 
gence test then, than he would have done when he was at the 
height of his school days.' This is demonstrated by the fact that 
in the relative mental ranks of the various occupational groups in 
the afore-mentioned Volume XV, the "student" is placed third 
from the top, apparently above the physician, above the clergyman, 
and above the accountant, notwithstanding the fact that all of 
these have been students at one time in their lives,' Consequently, 
a certain amount of caution had to be exercised in comparing the 
intelligence grades of high school individuals with those of mature 
persons in various occupational groups. For, a high school senior 
may readily score 127 points, which is the average for the physi- 
cian group on the Occupational-Intelligence Scale referred to, and 
yet be woefully deficient in mentality for the medical profession. 
In other words, his relatively high score may be due to the educa- 
tional increment, which is bound to innure to high school pupils 
of every grade of mentality by virtue of their constant immersion, 
forced or otherwise, in the educational waters.' It wa;:, therefore, 
necessary to strike a group of high school pupils not too long domi- 
ciled in the realm of secondary education, on the one hand, and 
among whom there would be found a mental level that would corre- 
spond, in points scored,- to the mentality of some definite occupa- 
tional group In Fryer's scale, on the other hand. 

•Sinee the ibove won irrtttCD Uorgarpt V. Colib's r/ie LImiU Set 1o Bia- 
caUonal Achlercmenl by LImtle-l liitflUoencr. Jour. Edue, I'sy. VoL XIII 
No. e, 1022, hnB made Its appparnnce and trum Iho figuTea presi-Qted In 
Table VIII. odp may iDfcr Ihat thone who have had only one year of high 
school education, will, LI ytaca luttr. sror? fievHU r'llntii luore tbao tbe; 
did BR high school freHhmen. tlione ivbo left hiRh acbool at the end of tbe 
Bopliomore re»r will. 15 yeura Inter, score live polntB leas than an sopho- 
morea. adulla of tbreo yenra' hltrli Kchuul trnlnlnir ivill Hcore 10 lees than 
they did aa Janliini and thuxp of four yitnrH blgli eohaol will acore 20 polnta. 
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Now it happened that in June, 1922, all prospective Freshmen of 
the Hartford Public High School, some 1200 in number, were giver» 
a modified Army Alpha test and the passing mark was set at 76 
points, equivalent to an I. Q. of 103 and to 50 per cent intelligence 
on our scale of 100. By dividing that scale into ten deciles, the 
uppermost, or "A" mental level, corresponded exactly with the 
occupational groups that fell into the "A" mental level on Fryer's 
scale. Thereafter, it was merely necessary to draw lines through 
all corresponding points of division on the Fryer scale and note 
whether the vocational choice made by a pupil of a given degree 
of intelligence fell within his mental level on the converted scale 
or not. 

In one respect Fryer's Occupational-Intelligence Scale is unsatis- 
factory for high school purposes in that it is not sufficiently com- 
plete in the matter of vocations. No provision is made in it for the 
professions of law, banking, journalism, high school and college 
teaching, nor for teachers of music, gymnastics, and cooking. Yet, 
there must have been hundreds of lawyers, high school teachers, 
college professors, bank tellers, not to mention instructors of gym- 
nastics, enrolled in the army. In an intelligence test given to fifty- 
five high school teachers, the writer found that their median on the 
Army Alpha test was 162 points, with a variation that ranged from 
94 to 199. Also, in the occupational studies made by the Division 
of Psychology, S. G. O,, lawyers are ranked second from the top. 
The writer felt justified, therefore, in placing lawyers, journalists, 
high school and college teachers in the "A" class on Mr. Fryer's 
scale. Authors and bankers were placed in the modified "B" group. 
Music, gymnasium, elocution, and cooking teachers, professions 
selected by high school pupils, as well as the indefinite profession 
"business", so frequently chosen by high school boys and girls, were 
placed in the modified "D" group. Among girls, those who chose 
dressmaking as their vocational ambition, were classified with tail- 
ors, and hair-dressers with barbers. 

Investigations conducted by various psychologists have demon- 
strated that the I. Q. does not change appreciably. The writer has 
thus far retested two high school classes at intervals of two years 
and has found practically no change in the average I. Q. attained 
by the same pupils as Freshmen, and two years later as Juniors. 
Thus, the average I. Q. of 288 Freshmen who had entered the Hart- 
ford High School in September, 1920, was 111; their average age 
iiavmg been 14 years and 6 months, and the average number of 
points scored by them on the writer's modified Alpha test haviiy; 

t iviis nlmiil 'i Alphn notn(9. Dpduct- 
iin 1. U ..t lie. Tliis Imrniupiiea with 
i]>roarhfe uiliiU luculalltr hla t. Q. 
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been 96, which is equivalent to a mental age of 16 years and 2 
months. The avera^ number of points scored by these same 288 
pupils in September, 1922, when they became Juniors was 116, 
which is equivalent to the mental age of 17 years and 1 month; their 
average I. Q. was consequently 104.° 

By adopting a percentage scale of mental alertness, the base 
of which is 152 points, equivalent to 100 per cent intelligence, for 
high school Freshmen tested three weeks before graduation from 
grammar school, and a scale with a base of 172 points for Sopho- 
mores, one with a base of 186 points for Juniors, and one with a 
base of 196 points for Seniors, the latter three groups tested at 
the beginning of their class careers, the writer has found but little 
displacement from one mental level to the other as the pupils 
progressed from the Freshman to the Senior year and were sub- 
jected to- two separate tests. 

Thus, the average per cent of intelligence for the above men- 
tioned 288 pupils, rated by their Freshman scores, was 59.0, and 
their average intelligence two years afterwards, rated by their 
Junior scores, was 62.3. The coefficient of correlation between the 
Freshman and Junior scores was +.875±.0O9. Fifty, on a scale of 

100, being the minimum requirement for passing our high school 
intelligence test, the corresponding passing I. Q.'s for the Fresh- 
man, Sophomore, Junior, and Senior classes are, respectively, 103, 

101, 98, and 95. The following table gives the points scored, per 
cent intelligence, and letter grade for each mental level in the four 
high school classes. 

TABLE I. 

COSIPAKATIVE INTELLIGENCE SCALES FOR HIGH SCHOOL 
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176-196 


90-100 


A 


121-136 


138-154 


148-166 


156-175 


80-89 


B 


106-120 


120-137 


130-147 


136-155 


70-79 
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91-105 


103-119 


111-129 


116-135 


60-69 
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76-90 


86-102 


92-110 


96-115 
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61-76 


69-85 


74-91 


76-95 
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68-68 


55-73 


56-75 
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If now we take Fryer's Occupational -Intelligence Scale, modified 
so aa to include the professions frequently chosen by high school 
pupils, and then group into the various mental grades the profes- 
rions that naturally fall into them by virtue of the average points 
scored by the members in each group, we obtain the following Oc- 
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cupational-Intelligence Scale especially adapted for high school 
pupils, and, though based on the intelligence achievements of high 
school Freshmen, is none the less applicable to upper classmen, 
when attention is paid to the letter grade in mentality instead of 
poinU scored. TABLE II. 

OCCUPATIONAL-INTELLir.ENCK SCALE FOR nlCII SCHOOL 
I'lTILS. 

Letter Av. Av. No. 

Grade I. Q.' Points Occupation 

162"| Teacher (College & High) 

161 Engineer (Civil & Mech.) 

A 126 ? I 141 Lawyer 

? f Journalist 

152 Clergyman 

137J Accounlant 

127 1 Physician 

7 Novelist 

B 122 122 1 126 Teacher (Grades) 

II9J Chemist 

Hi-, Draftsman 

C 116 ml 110 Secretary (Private & Institutional^ 

nor Dentist 

IO9J Executive, minor 

Stenographer & Typist 

Bookkeeper 

Nurse 

Clerk (office) 
i Clerk (railroad) 

"Business" 

Gymnasium Teacher 

Cooking Teacher 

Music Teacher 

Elocution Teacher 

Photographer 

Telegrapher & Radio Operator 

Musician (Band & Orchestra) 

Artist (Sign Letterer) 
D Clerk (Postal) 

Electrician 

Foreman (Construction) 

Druggist 

Foreman (Factory) 



'Derived trom t 



and ages In euch group. 
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Telephone Operator 
Carpenter (Ship) 
Policeman & Detective 
Auto Assembler 
T«ol Maker 
Plumber 

> Lath Hand (Production) 
Auto Mechanic (General) 
Auto Chauffeur 
Tailor 
Dressmaker 
Milliner 

Machinist (General) 
Actor (Vaudeville) 

Carpenter (General) 

Painter 

Farmer 

> Brick Layer 
Caterer 
Barber 
Hair Dresser 
Sales Clerk 



31 



Hospital Attendent 
Sailor 

Structural Steel Worker 



Not all of the occupations given in Fryer's scale are included in 
this modified one. Only those which were chosen at least once 
among the 512 pupils who expressed their vocafional preference 
are given a place in it. These are printed in heavy type. The' 
remaining occnpations are included as ones which the writer 
thought high school pnpils might possibly choose, at least tempo- 
rarily; also in order to serve as a means of comparison between 
the different types of vocational mental levels. 

Let ua now see what the 512 high school Freshmen actually did 
in the matter of choosing a vocation or indicating a vocational 
preference. Table III shows the degrees and the direction of vari- 
ation of vocational choice from mental level among the 250 boys. 
The numbers +5, -1-4, -1-3, etc., represent the number of mental 
levels, above that of the individual, wherein lay the vocation he 
chose. Minus one, — 2, etc, indicate the number of mental levels 
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below that of the individual wherein lay the profession he selected. 
The letters in the squares show in what mental level lay the voca- 
tion chosen; the numbers in the squares represent the number of 
pupils making that choice. 

The above table snowa some astonishing results. There is a 
conspicuous tendency for. the superior pupils, those of "A" and 
"B" mentality, to underrate their ability and to choose a profes- 
sion that falls in a mental level considerably below their own. 
And there is a still greater tendency for pupils of low mentality 
to choose professions that lie considerably above their mental 
levels. To be sure, the choosing of a profession that lies within 
one mental level above or below the one to which a particular indi- 
vidual belongs is no serious mistake. It is perfectly safe to assume 
that an individual of "B" mentality is quite able to pursue a pro- 
fession that lies in the "A" mental level, provided he puts forth 
enough industry. Likewise, there is no reason to suppose that a 
pupil of "C" mentality is throwing his future away entirely merely 
by choosing a profession that belongs to the "D" mental level. 
Therefore, in the treatment of the data presented in Tables III and 
IV we shall consider all individuals who vary but one degree in 
either direction as having made a proper vocational choice. It is 
only those whose vocational choice lies within two or more mental 
ievels above or below their own who will be considered as not 
having chosen wisely. 

With this proviso before us we find that of the thirty superior 
boys only 20, or 66.6 per cent, make a proper choice, whereas 33^ 
per cent choose some profession that requires far less ability than 
they possess, as judged by the intelligence tests. Of course, for 
the "A" pupils, there was no alternative but to choose a profession 
that lay either within their mental level or in some lower level; but 
why should three of the four "A" boys choose vocations that are so 
far below their own mental grade? The "B" pupils seem to show 
somewhat more courage, as well as more wisdom, than the "A" 
individuals, in choosing their vocations; inasmuch as 73 per cent 
of them select vocations that fall within their mental capacity. 
Among the boys of "C" ability only 44 per cent seem to make a 
proper choice, while the number that overrate their ability is 
twice as large as those who underrate it. When we come to those 
who failed in the intelligence tests, having scored a grade of "P" 
and lower, which is equivalent to 76 points and less on the Army 
Alpha scale, we find that no less than 88 per cent of them select 
professions that are anywhere from two to five mental levels above 

To be sure the claim may be made, and justly too, that the so- 
called professions lie within the three highest mental levels, and 
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inasmuch as the very presence of boys in high school already 
indicates a leaning toward some profession, it is only natural that 
they should tend to overrate their ability, as judged by their voca- 
tional preference, rather than to underrate it. But this simply 
shifts the ar^ment back one step by taking the problem out of 
the high school and placing it within the grammar school and home. 
It merely means that American children tend to overrate their 
ability even before they get into high school. Judged by the large 
proportion of high school failures, it being something like 60 per 
cent, one must say that the above statement is not far from being 
accurate. Moreover it is significant to note that among the mental 
failures a larger proportion, fully 48 per cent, choose a profession 
that lies in the "A" and "B" levels than do the pupils of either 
*'E" or "D" ability, the percentages of excessive vocational over- 
reaching in their cases being 40 and 42, respectively. In other 
words, the distribution table plainly shows that the lower an indi- 
vidual stands in mentality, the higher seems to be his vocational 
ambition. Whether this is a manifestation of compensation, the 
desire filling the gap within the mind, or whether it is simply a 
further indication of poor judgment and inability to envisage the 
future in matters practical as well as ideal, is a topic for separate 
discussion. 

Nevertheless, there is sufficient evidence at hand to indicate that 
it is the latter and not entirely the former. Investigating the pro- 
portion of pupils in the various mental levels who survived the 
high school curriculum for at least two year.s, the writer has 
found that in the Hartford Public High School fully 73 per cent 
of those who fail in intelligence at the beginning of their Freshman 
year do not succeed in becoming Juniors. Either they drop out 
of school altogether, or remain in a lower class because of poor 
scholarship. According to Cobb." 87 per cent of the Freshmen who 
score below 77,5 points drop out before the Senior year in the 
Michigan high, schools, and in Madsen's group about 84 per cent 
of such individuals drop out. Now, in view of the fact that the 
professions within the "A" and "B" groups require considerably 
more than mere high school training, it is (juite obvious that of the 
thirty-seven "F" and "G" mental level pupils who selected profes- 
sional occupations for their career, practically three-quarters of 
them will not proceed far enough in higher training even to come 
within reach of a high school diploma. Once more according to 
Cobb, only about 4.5 per cent of them may be expected to enter 
college.* 

I Arhlcicmtnl liy l.\»nlc<l Inttlliae«vi', Juur. 
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DEGREE AND DIRECTION OF VARIATION OF VOCATIONAL CHOICI 
FROM MENTAL LEVEL AMONG BOYS, 
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To judge by the professions these 250 boys wish to enter, we 
may say that ten per cent overrate their ability by five mental 
levels, eight per cent overrate themselves by four mental levels, 15 
per cent by three mental levels, and 14 per cent by two mental 
levels. In brief, 48 per cent of all the boys overrate their ability 
by choosing a profession that lies in a mental level that is from 
two to five grades above their own. Forty-three and two tenths 
per cent seem to choose wisely, in that the profession they select 
lies within a mental level that varies only one degree from their 
own. Eight and eight tenths per cent underrate their ability by 
choosing a vocation that lies in a mental level which is two or 
more grades below theirs. The coefficient of correlation between 
the intelligence and vocational choices of these 250 boys is 
+.045 ^.042. Practically zero. 

Fryer's Occupational-Intelligence-Scale does not lend itself very 
readily for the classification of girls in the same manner as 
boys, for the very good reason that the occupations considered 
are chiefly those for men. Nevertheless, it contains the profes- 
sions of teacher, stenographer and typist, bookkeeper, nurse, and 
clerk, which constitute nearly 90 per cent of the professions 
selected by high school girls. By including the professions of 
music, cooking and gymnasium teachers with the class of book- 
keepers, nurses and stenographers, as we have done, we have, it 
seems, made provision for practically every profession that a 
high school girl would be likely to choose. With these additions, 
we were surprised to discover that of the 262 girls, who indi- 
cated their professional choice, only one selected a vocation for 
which no provision could be made on this modified Occupational 
Scale, and that one was acting, presumably in drama. Tabu- 
lating the girls in the same manner as we did the boys, we obtain 
Table IV. which shows the extent and the direction in which their 
vocational choice varies from their mental level. 

The similarity in the distribution curve for boys and girls is 
remarkable. Here, too, we find that 45.8 per cent of the girls 
overrate their ability by choosing vocations that lie within two 
or more mental levels above their own. Forty-eight and one 
tenth per cent make a proper choice and 6.1 per cent underrate 
themselves. The coefficient of correlation between intelligence and 
vocational choice for the girls is -I-.0987 ±.041. In spite of the 
fact that the scale was based on vocations pursued by men, we 
find that it is applicable to girls, and, indeed, girls seem to 
choose their vocations a little more intelligently than do the boys. 
Before summing up the results of our study, we must once 
more forestall the probable objection that the reason why these 
pupils tend to overrate themselves by choosing vocations that 
lie BO high above their own mental levels is because their in- 
telligence has been judged too early in the stage of mental de- 
velopment. There is no ground for such criticism. First, be- 
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cause the average mental age of these pupils w&a IS years and 
6 months their average I. Q. 107. This is considerably higher 
than the average mental age and I. Q. for the American popula- 
tion as a whole. In the second place, the "A" mental group of 
these pupils coincided exactly with the "A" group on the Occu- 
pational-Intelligence Scale in the number of Alpha points scored. 
None of the deciles in the higher classes could be so compared with 
the mental groups on Fryer's Occupational-Intelligence Scale. 
Thirdly, an intelligence test given to 105 evening high school 
pupils, all of whom were grammar school graduates, some of 
them being college graduates, some grammar school teachers, 
one professional nurse, three machinists, and most of the others 
time-keepers, bookkeepers, store clerks, and office clerks yielded 
an average score of 90 points, which is only five points above the 
average for the 512 high school Freshmen considered in the 
above tables. Fourthly, the average intelligence of our "D" 
group (95 points) is aimut equal to that of adults who had one 
year of high school training and were tested 15 years later." 
The average of our "C" group is equal to that of adults who had 
gone through Junior year in high school and were tested 15 
years out of school. The average intelligence of our "B" group 
is higher than the average intelligence of adults who had been 
graduated from the high school or who had Ijeen college fres">- 
men and were tested 15 years later. With Tespect to the "E" 
pupils, investigations have thus far shown that not more than 30 
per cent of them succeed in becoming high school seniors. 
CONCLUSIONS. 
The above study leads to the following conclusions: 
First: Only about 46 per cent high school pupils make 
proper vocational choices — choices that can be realized by them and 
which they will pursue with maximum satisfaction and efficiency. 
Second: About the same number, 47 per cent, make vocational 
choices that lie considerably beyond their mental reach. Pre- 
sumably, this proportion of pupils will either not gain their de- 
sired vocations or, such as do, will not be entirely efficient in 

Third: Approximately 7 per cent underrate their ability by 
choosing vocations that lie considerably below their own mental 

Fourth: It would seem advisable, therefore, that the first 
duty of the high school vocational guide or vocational educator 
should be to acquaint himself with the intelligence of the 
pupils to whom he would give vocational advice. 

Fifth: Viewed from the social standpoint it cannot be said 
that the American youth is devoid of ambition. He may not 
always put forth the necessary effort to realize his aim, but, 
judged by the goal that he sets for himself, he certainly has far 
reaching desires. 

'"Cobb, Op. fit. Table B, p. if,0. 



tELATION OF MENTAL ALERTNESS TEST SCORE 
TO POSITIONS AND PERMANENCY IN COMPANY 



By Marian A. Bills 

Bureau of Personnel Research, 

Carnegie Institute of Technolo^. 

Three yeara ago the Bureau of Personnel Research Carnegie 
nstitute of Technology, gave a mental alertneaa test to a large 
lerical force. The total results were made practical use of by 
be firm. The experiment described below is simply a by-product 
f that investigation but holds, we believe, several points of 

From the test scores of the entire clerical group those of a 
.undred thirty-three individuals working at five distinct jobs, 
rere drawn off for special study. These five jobs were chosen 
or three reasons. (1) The jobs were all individual jobs, none 
f them involving supervisory duties. <2) They represented five 
listinct levels of difficulty of work. (3) A sufficiently large 
lumber of individuals were working at each of the five jobs, so 
hat an average would have rneaning. 

Thirty months later the subsequent history of these one 
lundred and thirty-three individuals was studied, as regards one 
act, were they still on the job? This gave us a perfectly objective 
Titerion.' 

The date thus obtained was studied with the following questions 

(1) Is there a relation between positions in the company and 
nental alertness score? (2) Does a natural selection take place 
vith time that makes this relation more evident? 

We would expect natural selection to take place in two ways, 
■"irst by the persons making low scores in the mental alertness 
est being unable to handle high grade work and leaving and 
lecond by persons making high scores in the mental alertness 
«st becoming dissatisfied with low grade work and leaving. That 
s at the end of two and a half years, we would expect that the 
iverage mental alertness score of those remaining in the high 
^ade jobs would be higher than the average of the original 
^oup. And that the average score of those remaining in the 
ow grade jobs would be lower than that of the original group. 
[n short, if mental alertness is a prominent factor in clerical 
vork, we would expect the groups to become more distinct when 

irmiil or rudnE xyHtPin hn<I Ket-a 
would liuTi- bcpn tuo luJi-llnltu a 



-only those persons are considered that 
than two and a half years. 



RESULTS. 

The correlation between the mental alertness score and the 
level of difficulty of work performed by the individual was for 
the original group +.22, for the group remaining after two and 
one-half years +.41. That in thirty months raised the correla- 
tion 19 points. 

In order to study the effect of natural selection in more detail, 
we have split each grade into three classes: (1) Those scoring 
above 110; <2) Those scoring between 80-110; (3) Those scor- 
ing below 80. The dividing scores chosen are arbitrary but were 
taken because they seemed from the distribution of cases to be 
natural breaking points. Interest centers around groups one and 
thr'ee. Group two contains about 25 per cent of the cases and may 
be considered a neutral group. We have lettered the five jobs 
from A to E, A being the least difficult job, B being more dif- 
iicult than A, and less difficult than C, and E being the most 
difficult job. 

The following two tables give the data for (1) the original 
group and (2) the group remaining after two and one-haU 



ORIGINAL GROUP. 



Per cent scor- 



D 

E 


56 103.5 46 30 
22 118.5 50 13 

GROUP REMAINING THIRTY MONTHS. 




■Grade of 
. Work 


No. in Median Percent Percent Percent 
Grade Scores scoring scoring turn- 
over 110 under 80 over for 
those 


Per Cent 
turn- 
over for 
those 




scoring 
over 110 


scoring 
under 80 



95.0 
111.0 
123.0 
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The following points would seem to be noteworthy. 

(1) ,In the original group the median scores of the gradea 
range from 77,5 to 118.5, forty-one points. There are two in- 
stances where a lower grade job has a slightly higher median 
score than the next higher grade job. In the group remaining 
thirty months the median scores of the grades range from 67.5 
to 123.0, 56.5 points. Each grade shows a higher median than 
the grade below it. 

(2) In the two least difficult jobs A and B, no one scoring over 
110 has remained. In the C grade a smaller per cent of the 
remaining than the original group have scores over 110, while 
for the D and E grade, a larger per cent of the remaining 
group have scores over 110 than of the original group. 

(3) Almost the opposite holds when we consider the group 
scoring below 80. There is a steady decrease of the per cent 
scoring below 80 with the rise of the grade of work. There is 
also with one exception an increase in turnover in this group from 
A to E. 

These results are as a whole confirmed by a study of 330 other 
cases from the same firm where many jobs were lumped together 
as being of the same difficulty and the grading was much less 
carefully done. On account, however, of the inaccuracies that 
we know entered into the grading, we do not believe the results 
are worth quoting in detail. 



A STUDY OF THE CORRELATION OF COLLEGE 

STUDENTS' ESTIMATES OF INTELLIGENCE 

WITH THE OTIS TESTS AND OTHER 

SCALES 

Bv J. U. Yasbrough 

Carnegie InstituK of Technology, Pittsburg, Pa. 

It is a matter of common observation that college studenta- 
select certain of their number to designate as superior, bright, 
and intelligent; and just as frequently do they select others from 
their group and call them inferior, stupid, and dull. Each 
student soon after entering college is thus tacitly assigned to his 
group by his fellow students, and thereafter student conduct 
toward him is in accordance with this assignment, regardless of 
the method through which or the circumstances under which the 
judgment was formed. After observing this practice of more or 
less unavowed placement by students in some of our largest 
universities, and finding it to be as common as in our smaller 
colleges; and too, after observing the certainty with which a 
group of students act toward a fellow student when once it haa 
placed him intellectually, the writer set about to devise some 
scheme for testing the accuracy with which college students place- 
their fellows in the scale of intelligence. 

In order to make this test the judgments of a group of college' 
students were secured and analyzed. The criteria used by each 
student in estimating the ability of fellow students were listed in. 
terms of human traits. These traits were used as a basis for 
rating all members of the class. This final rating of the students 
by the class was correlated with the rating on the basis of their 
score on the Otis Test, instructor's estimate, and college grades. 
METHOD OF ANALYZING THE STUDENT'S JUDGMENT. 

The students used in this experiment were of junior and senior 
rank. They were in a small compact college where the students 
were brought together daily in their school routine; where, in fact, 
the success of the existing system of student self government 
depended largely upon this close contact. Moreover, they hai 
been associated in this class in psychology for a period of six 
months and had full opportunity to observe each other in claw 
discussions and work in general. Their work in this class had 
been in general psychology with no special emphasis placed upon 
the topic of intelligence. 

These thirty students were provided with paper and pencil and 
without any foreknowledge of the content or purpose of Ote 
experiment were asked to answer the two questions given, below aa 
the experimenter dictated them: 
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1. Do you make it a habit to rate one of your fellow students, 
A, as intelligent and another student, B, as stupid? 

2. Enumerate the six human traits which you moat frequently 
use in rating your fellow students. 

After question I was given and the answers were written on the 
paper provided, the second question was dictated. The students 
were told to use all the time they wanted, but to write down the 
traits as rapidly as they thought of them. Each member of the 
class was requested to prepare his list without communication 
with other members. This request was diligently observed. At 
the end of twelve minutes all students had completed their lists, 
and were very anxious to report and hear others report. Each 
student desired to know whether or not his list if six human 
traits had been partially or wholly reproduced by some other 
member or members of the class. 

Student No. 1 was called upon to place on the board before 
the class the list of six human traits most frequently used by 
him in judging the intelligence of his fellow students. 

Student No. 2 was asked to add to the list on the board any 
trait or traits from his list of six which were not mentioned 
by Student No. 1. Thus we proceeded through the entire class. 
Should each student use a difTerent list of human traits in form- 
ing his judgments, and thereby add six traits to the list on the 
tmard, 180 human traits would be enumerated on our master 
list. But this did not happen. No one could expect this to 
happen. However, we doubt if many would think that students 
use so nearly the same criteria in judgment that, of the 180 pos- 
sibilities only 13 were actually enumerated by the entire class. 
And under discussion of the class this list of 13 traits was re- 
duced to 6. The 13 traits listed below are given in the same 
'Order as they were listed on the board by the students. 
1- Quick perception. 

2. Adaptability. 

3. Leadership in student group. 

4. Ability to reason beyond self-interest. 

5. Mental alertness. 

6. Retention of learning — memory, 

7. General appearance and r 

8. Social poise. 

9. Laughter. 
10. School grades. 
IL Philosophy of life. 

12. Originality in thinking. 

13. Enjoyment of play. 
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In the opinion of the class there was overlapping in these 
characterizations. Therefore, through considerable discussion 
and definitions we were able, as stated above, to reduce this list 
to six. These six traits which were to form the students' master 
scale are given below: 

1. Leadership among students. 

2. Impersonal reasoning' — ability to reason beyond one's own 
selfish ends. 

3. Mental alertness — quickness and ease with which novel 
material is grasped. 

4. Appearance and manner — ability to present one's self to 
win confidence and respect. 

6. School grades : Grades on all college courses. 

6. Originality in thinking: Habit of thinking and doing 
things in an unusual way. 

A careful study of the six remaining traits reveals the fact 
that they, when properly defined, include the 13 former characteri- 
zations of the original list: No. 1 is included under No. 3 of the 
final list; No. 2, under 1 and 3; No. 6, under 5; and Nos. 8, 9, 11, 
and 13 under 1, 3, and 4. The class was in full agreement in 
every instance, except in the case of No. 9 — laughter. All agreed 
that "laughter" could be placed under "appearance and manner," 
yet three students insisted that as a trait for diagnosis of intel- 
ligence it is too important to be subordinated in any way. 

THE STUDENTS' RANKING OF THE SIX TRAITS 
SELECTED. 
At another meeting of this same class the students were re- 
quested to rank these six human traits on the basis of their 
importance in determining intelligence. Each student was pro- 
vided with a printed list of the six traits, and asked to follow 
directions carefully as they were read. "Do exactly what I tell 
you. Select that one of the six human traits listed here which 
you think is of greatest value in judging intelligence in a 
fellow student. Mark this trait 'highest.' Now, scluct that i.r; 
of these six traits which you think is of least value in judging 
the intelligence of your fellow students. Mark this 'lowest.' 
With this done, select that trait midway between highest and 
lowest in value and mark it 'middle.' Select that trait no« 
which is of less value than the one marked 'highest' but of 
greater value than the one marked 'middle.' Mark this trait 
'high.' Then select a trait which is not so good as middle but 

'r>iirins the rluM« Uiwunslon It was m.idp plnln by thP Btuilenta that by 
•'iiiiiier«onul rpuBOnlnc" llipy iiu'ant [he ubilily lo »olv« a prublem to 111 
conclusion wUbout clauiJIiiK tbe Ibhuc by Ibe Intruslun of the persaul 
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better than lowest. Mark this one 'low.' Take the remaininfc 
trait of the original six and compare its value with that of each 
of the other five. Place it between those two which it is most 
like." 

When this ranking had beer completed by the class and the 
results tabulated, the final six traits were arranged in the 
order of their relative importance in determining the intelligence 
of a fellow student. Their relative positions are: 

1. Mental alertness. 

2. Appearance and manner. 

3. Originality. 

4. Leadership. 

5. Impersonal reasoning. 

6. School grades. 

By accepting these six traits as the criteria for judging in- 
telligence we were able to use this as a master scale for rank- 
ing college students. 

Some objection may be offered to the acceptance of these 
traits as criteria for measuring intelligence. It may be urged 
against some one, perhaps any one, of these traits that there is 
no relationship between it and intelligence. Question ; Are these 
traits earmarks of intelligence? To what extent these several 
traits are characteristic of intelligerce it is difficult to say. Yet, 
the following two types of evidence persuaded us to accept them 
as worthy criteria. First, they represent the consensus of opinion 
of an average group of college students as to what they think 
intelligence is. That they had the correct conception of the 
term "intelligence" we are not arguing. We do think, however, 
that they had in mind what they call "intelligence," and what 
they constantly use in placing their fellow students intellectually, 
and their success in this placement is the aim of this study. The 
second type of evidence is found in the correlation between 
these several traits and the results of the Otis Test. When the 
students were rated on these traits, as is shown further on in 
this study, and compared with their rank in terms of the Otis 
Tests the respective value of these traits as characteristics of in- 
telligence is exhibited. The Otis Tests correlate with "mental 
alertness" .49, with "appearance and manner" .16, with 
"originality" .48, with "leadership" .24, and with "impersonal 
reasoning" .38. While "appearance and manner" was con- 
sidered by the students as the second best characteristic of in- 
telligence, this trait does not seem to be important to success in 
the Otis Test. There is a reason for this. And it it this reason 
Tvhich causes many people to discountenance intelligence tests. 
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and hark back to the practice of the persona! interview. And for 

the same reason others hold that the intelligence teat and the 
personal interview are mutually supplementary. 

CLASS MEMBERS RATED BY MASTER SCALE. 

a. By the Sttidenln. The class roll in strictly alphabetical 
order was printed on the left side of a large sheet of paper. 
Near the top, the middle, and the bottom of the page was printed 
'highest,' 'middle,' and 'lowest,' respectively. Midway between 'high- 
est' and 'middle' the word 'high' was printed, and midway between 
'lowest' and 'middle' the word 'low' was printed. One such sheet 
was provided for each of the six traits of the master scale. The 
class was directed to rate its members in the same way that it 
rated the six traits of the master scale on the day before. When 
the class was rated on mental alertness, the papers were gather kI 
up. Two days later data were secured in the same way on ap- 
pearance and manner. This two-day interval was allowed that 
we might avoid the chance of habitually assigning a man to b 
certain place on the scale. Only five of the traits were rated by 
the students, since the college grades were secured from the 
university records. 

By an examination of Table No. 1 several interesting points 
are observed. 1. In the judgment of the class no one student 
possessed all five traits in the highest degree. Student No. II, 
who makes first place in three traits, is the nearest an exception 
to this. 2. One may rank high in one trait and low in another. 
Student No. 8, for example, is given sixth place in mental 
alertness and twenty-sixth in appearance and manner, and No. 3 
ranks second in impersonal reasoning and twenty-seventh in 
appearance and niarner. Students 25, 26, and 27 also indicate 
the truthfulness of this statement. 

This observation is not in line with the "halo" theory as pre- 
sented by Thorndike. His findings seemed to indicate that those 
giving the ratings were unable to analyze out these different 
aspects of a person's nature and rate each independent of the 
Others. "All ratings were effected fay a marked tendency to 
think of the person in general as rather good or rather inferior 
and to color the judgments of the qualities by this general 
feeling. A halo of general merit is extended to influence the 
rating for the special ability, or vice versa."" While the data 
here do not indicate the presence of this tendency generally, 
yet in some outstanding cases it seems to have been operative. 

'Tliormllkp, E. 1..: .1 (.■uji*/u.i( I.nor In Puiiihiiliiiiical Ratiayi, Jour. AppL 
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TABLE NO. I. 

STIDENTS' ESTIMATES OF I^'TI::LLIGE:^'CE 

Student Mental Appearance Origin- Leader- Imperaonal 
No. Alertness and Manner ality ship Reasoning 



18 



To show more fully the extent to which the several t 
correlate with each other the table of intercor relations is { 
below. TABLE NO. IL 

INTERCOERELATIONS OF TRAITS. 

. ii b 



Mental Alertness 
Appearance and Manner 
Originality 
Leadership 
Impersonal Reasoning 

Average 






s-a 
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.34 
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.53 
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.54 
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.55 


.20 


.53 


.39 
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With this group of students "appearance and manner" is least 
indicatire of mental alertness. In fact, the two traits do not 
appear to hold together. From Table No. 2 we also note that 
"originality" shows the highest while "appearance and man- 
ner" shows the lowest intercor relation with these specific traits. 
Then "originality" would therefore, give us the most information, 
and "appearance and manner" the least information about this 
whole group of traits. 

b. By the Instructor. Using the same method aa the students, 
the instructor rated the members of the class on each trait of the 
scale the results are given in Table No. III. 
TABLE NO. III. 

INRTRrCTOR^S ESTIMATES OF STUDENTS. 

Student Mental Appearance Origin- Leader- Impersonal Rank 

No, Alertness and Manner ality ship Reasoning 

1 27 7 28 21 27 24 

2 13 16 17 16 14 14 
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Olnervations made from Table No. I also apply here. Where 
the rating of a student in one table is compared with that 
student's ratine in the other, this observation is made. Onlj' six 
students are rated the same on any one trait in both tables. Of 
these, four are on leadership. They are Nos, 11, 14, 17, and 25. 
This agreement, though slight as it seems, selects the highest 
ranked leader and almost the lowest. 

The intercorrelations of the traits as presented by the ili- 
structor's estimates are shown in Table No. IV, 



Mental Alertness 
Appearance and Manner 
Originality 
Leadership 
Impersonal Reasoning 
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.80 


.14 


.45 


.43 






Total .61 .29 .56 .51 .46 

"Mental Alertness" shows the highest inter cor relation of all 
the traits with "originality," the students' most significant trait, 
taking second place. "Appearance and manner" continues to be 
the lease significant of all the traits. 

CORRELATION OF STUDENTS' ESTIMATES OF INTELLI- 
GENCE WITH STANDARD SCALES. 

In order to test the value of students' estimates of the intelli- 
gence of fellow students by means of these traits, we have 
brought together in Table V the results of Tables I and III and 
the students' ranking in both college grades and the Otis In- 
telligence Test. 

In column No. 1 the students are ranked by the class on the 
basis of the six traits in Table I. Column No. 2 contains the 
ranking of the same students by the instructor on the basis of 
these same six traits. In column No. 3 the students are ranked 
according to their grades in the office of the University. The 
ranking of the students on the Otis Group Intelligence tests is 
presented in column No. 4. Their scoi'es were made on the 
"AdvaBced Examination: Form A. Edition 1921." 

The instructor's estimate and college grades are combined 
for the ranking given in column No. 5. This is done to get a 
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comparison of this combined rating with the results on the Otis 
Test. Before attempting to compare the estimate made by the 
students to any of these standards, I think it wise first to de- 
termine the value of the instructor's estimate, the college grades, 
and the Otis Intelligence teats in relation to each other. Since 
the Otis test is generally accepted as a standard measure of in- 
telligence, I win evaluate the others in terms of it. By compar- 
ing column 2 with column 4, one secures a correlation of .46, 
between the instructor's estimate and the Otis Test. In the 
same way the relation between college grades and the results on 
the Otis test is found by comparing columns 3 and 4. This 
correlation is .63. By a comparison of the rankings in columns 
2 and 3 the correlation between instructor's estimate and college 
grades is found to be .41. The instructor's estimate and college 
grades are often combined in judging intelligence. Their com- 
bined value when compared with the Otis teat is found by com- 
paring columns 4 and 5. The correlation is ,57. When combined 
in this way they give a higher correlation with the Otis teat 
than either one when taken alone. These correlations are 
"markedly present," yet not too high. However, since both in- 
structor's estimate and college grades are in such common ase 
I am using them as standards along with the Otis Intelligence 
Test. 

These three standards are significant because of the fact that 
they are of different types. The Otis Test is a theoretical attempt 
to build a scale of measurement. Its further value lies in the 
fact that its scores check favorably with scores made on other tests 
which are equally sound in theory. The instructor's estimate is 
an entirely different kind of standard. It is an individual judg- 
ment, while the students' estimates form a composite judgment. 
Theoretically this last should he the proper basis for judging, for 
after all this is the final criterion in the business world. It is the 
composite judgment of one's fellows that places one at a particu- 
lar level. Hollingworth finds that group judgment is more ac- 
curate than the judgment of the individual. "The individual 
judges intelligence with a correctness of only .19 on the average; 
the group judges intelligence with an average correctness of .61." * 

a. Instructor's estimate. By a comparison of columns 1 and 2 
of Table V one is able to determine the relationship between the 
students' estimate of intelligence and that of the instructor. This 
relation, expressed by means of correlation is .61. This is a 
rather high correlation and would seem to justify the conclusion 
that the summation of the opinion of students with the maturity 
and college rank of this class is as good a measure of intelligence 
as their instructor's judgment. 
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TABLE NO. V. 

E8TIUATB8 AND STANDARD SCALES. 



Inst. 
Estimate 



29 18 29 14 9 24 

30 24 13 23 11 16 

b. College grades. When the rating of the members of the class 
made by the students and found in column 1 is compared with the 
results based on college grades and given in column 3, the correla- 
tion is found to be .34. This is in keeping with the student judg- 
ment, for when building their scale they placed college grades as 
the poorest of the six traits for measuring intelligence. One 
must not confuse the student's ability to make college grades with 
what he actually does. These students are ranked on the grades 

U Human ClMiracter' pnK« 41. Slmlliir flniUnan am 
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they have actually made. We cannot say how nearly they ap- 
proach the best of their several abilities. 

c. Otis Intelliffence Testa. As a final measure of the students' 
estimates of intelligence the students are ranked according to 
their success in the Otis Intelligence Tests. The range of their 
scores on this test was from 126 to 203. The correlation of the 
two rankings thus given in columns 1 and 4 in Table V is .61. 
Students estimates of intelligence compare very favorably with 
the results of the Otis Test, slightly better, in fact, than other in- 
vestigators have found college grades to relate to intelligence. 
Pressey obtained a correlation of .48 between intelligence and 
school marks.' Terman found a correlation of .45 between school 
markr and mental age.' Book reports the coefficient of correlation 
for hish school seniors between school marks and intelligence to be 
.47.' If, therefore, we take the Otis Intelligence Test as a stan- 
dard the consensus of student opinion must be highly respected 
as a r.ieasure of int«llisence. 

SUMMARY. 

1. Correlation Summary: ^ g 

is s 2 I i 1 '-e 

II 2.1 l-S ^ ""^ 

Students' Estimates 

Instructor's Estimates 

College Grades 

Otis Tests 

Col. Grades and Inst. Est. 

Average .49 .59 .52 .52 .67 

2. It the instructor's estimate is an accepted standard, the 
consensus of student opinion, gained under the conditions of onr 
experiment, is a better measure of intelligence than college grades 
or the Otis Tests. 

3. If the college grades are taken as the accepted standard the 
students' estimates are not so good a measure of intelligence as 
either the instructors' estimates or the Otis Tests. 

4. Accepting the Otis Tests as a standard, the students' esti- 
mates are practically as good a measure as either the inatrustors' 
estimates or the college grades. If, however, the instructors" es- 
timates and college grades are combined, they give a slightly 
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A SCHEME FOR COMBINING INCOMPLETE 
RANKINGS 

By B. p. Haoght 
The State University of New Mexico 

School marks are usually assigned to several groups of students 
in terms of letters. The number of groups ranges from three to 
seven. When these marks are to be combined in such a way to get 
the student's average standing, the task is found perplexing and 
often ambiguous. Sometimes percentage values are assigned to 
each letter and these values averaged. In other cases point val- 
use as 5, 4, 3, 2. 1 and are assigned to the letters A, B, C, D, E, 
and F respectively and the average found. Both of these methods 
often give very unsatisfactory results. The principal cause for 
this is the variation in the absolute marks assigned by different 
instructors. In some classes where there is no reason to infer 
that the selection has been great, a large per cent of the class 
receives high grades and at the same time in other classes the 
low grades are more numerous. In order that the work for the 
semester or term may be averaged in a satisfactory manner, it is 
desirable to find some scheme that will partially eliminate this 
■wide variation in teachers' judgments. 

Teachers agree much more closely in ranking a group of stU' 
dents or a bunch of examination papers than they do in assigning 
absolute grades in terms of letters or percentages. Usually there 
is no difficulty in ranking the best and the poorest fourth of the 
class. It is not usually difficult to rank a class of thirty with con- 
siderable accuracy. The smaller the class the easier the task 
unless the process of selection has been very great. Even then, 
if vigorous work is required and the tests are made difficult 
enough, individual differences are revealed. 

That instructors do vary greatly in their marks does not need 
further proof to those who have had experience with teachers' 
grades. That rankings made by different teachers are less vari- 
able and consequently much more reliable may not be accepted so 
readily. Meyer published the distribution of marks assigned by 
forty professors at the University of Missouri to their students 
in a period of five years. These distributions show that the per 
cent of A's assigned ranges from 1 to 55. Similar tabulations 
have been published for Harvard University, University of Wis- 
consin, and Cornell University '. All these tabulations furnish 
evidence of the wide variation in marking. Starch presents fur- 

'Storcli. Daniel: t'lliirollowoj I'eucliology ; l!l-.>0, 42l(-31. 
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ther evidence to show that the variation amons teachers in mark- 
ing the same paper is just as great. When school work in two 
subjects like arithmetic and language, however, is correlated, a 
marked or high correlation ia usually obtained '. This is evidence 
that, although the teachers have varied greatly in the specific 
marks assigned, they have not varied so much in the order of 
ranking. 

If we admit that ranks are more accurate than the traditional 
school marks, are we any nearer the solution of our problem? 
How are we to combine these ranks? No instructor will rank all 
the students in any one class. How shall we weight a rank of 1 
in a class of 5 and the same rank in a class of 35? Certainly 
they should not have equal weight. 

The first investigation that attempted to solve this problem, as 
far as the writer knows, was by Professor E. L. Thorndike '. 
Recently other investigations have appeared. Important among 
these is the one by M. J. Ream '. Ream's method is only a modi- 
fication of the one set forth earlier by Thorndike, but certainly 
is better in being more accurate and less laborious. The scheme 
here presented is only a modification of that suggested by Reani. 
It is better for two reasons. First, it eliminates negative signs 
and decimal fractions, both of which are likely to cause errors, to 
say nothing of the extra time and care. Second, the units are 
expressed in percentiles instead of in standard deviations. The for- 
mer has more meaning to the average person. It is, of course, 
true that they amount to the same thing. 

It is assumed that al! distributions are normal and that any 
skewness is due to the teacher's inaccuracy in grading or mark- 
ing. This assumption is not absolutely true, but it is much truer 
than to assume the distributions obtained from the teachers* 
grades correct. In the writer's opinion, to throw a distribution 
into percentiles and thus give it the form of the normal frequency 
curve corrects many errors of judgment on the part of the 
teacher. It will have to be admitted, however, that it introduces 
some errors as well as retains some of those already there. This 
is especially true when the group being considered is highly 
selected. 

A concrete example of how the percentiles are found for a 
class of six will make the procedure clear. First, the numbers 1, 
2, and 3 are divided by G, the number in the class. This gives 17, 

'Ttiorniliki'. £. L.: The TerhulQiie of OntnblHimj iHvompletf Jii'liimcaU at 
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Sd and 50. Second, from Thorndike's Mental and Social Measure- 
ments, Table 64, the numbers corresponding to 17, 33 and 50 are 
1.49, .68 and .22 respectively. Third, 3 is added to each of these 
numbers to give the distance in terms of the standard deviation 
from the lower end of the distribution instead of from the middle. 
Fourth, each of the three sums is divided by 6, the length of the 
distribution in terms of the standard deviation. The quotients, 
75, 61 and 64 are the percentiles. The scores for the lower half 
of the group may be found by inspection since the distribution is 
assumed to be symmetrical. 

Method of application. Now suppose we wish to And the aver- 
age score of an individual. Let us take an actual case, that of 
student X. He ranks 

1 in a class of 6 

1 in a class of 42 

2 in a class of 18 
2 in a class of 22 

13 in a class of 40 
By consulting the tables, we find the corresponding percentiles to 
be 75, 91, 73, 75, and 58 respectively. The average of these is 
74.4. In a like manner the average may be found for all other 
students. 

At the University of New Mexico, each instructor is requested 
xo rank the upper half of his classes and include these rankings 
in his final semester report. For the semester ending January 28, 
1922, the writer asked each instructor to rank the lower as well 
as the upper half of the class. Two exceptions were made. The 
instructor of history was not able to have charge of his classes the 
last month. They were taught by substitutes and for this reason 
are not included. The other exception was music, which probably 
depends more upon special ability than upon general intelligence. 

After all the data were assembled, the average for each student 
was found in a manner similar to that used in the illustration 
above. All subjects that were not ranked as many as three times 
were discarded. No attempt was made to separate the college 
classes. If freshmen and seniors happened to be in the same 
class, they were ranked without respect to classification. No dis- 
tinction was made for classes meeting two, three, four, or five 
times a week. This could have been done, but seems foreign to 
the problem. 
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During the semester the writer gave the Alpha tests to 148 
-students in the University. A few of theae dropped out before the 
end of the semester. Altogether there were 138 who had scores in 
scholastic achievement and in the Alpha tests. The 138 students 
were assigned percentile ranks in each trait. These were assigned 
in such a way as to make the distribution take the form of the 
normal probability curve. 

As a check on this method of finding scholastic scores, the fol- 
lowing values were assigned to the several letters and the atu — 
dent's average grade found : 

B=88% E=67% 

C^81% F=50% 

After these averages were found, the 138 students were assignedK. 
percentiles so as to give the distribution the form of the nonnaK- 
probability curve. Three correlations (by the product-moment 
method) were now obtained: first, between intelligence tests and 
the scholastic standing determined wholly from the ranks; second, 
between the intelligence tests and the scholastic standing deter- 
mined by assiging absolute values to the letters indicating the 
grades; and third, between the scholastic standings determined by 
the two methods indicated above. The three correlations are re- 
PQctively, as follows; 



The method of disregarding absolute grades and using only the 
ranks, then, "gives a more reliable result judged from the intelli- 
gence tests as a criterion. The difference between the two methods 
is small, yet it is sufficient to be significant when this number of 
subjects is used. The two scholastic rankings have a high corre- 
lation, yet it is far from perfect. 

Great scientific accuracy is not claimed for the scheme here 
set forth. It is as accurate as any now in use and has the ad- 
vantage of being very simple and easy to manipulate. The 
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laller the class the leas reliable are the results. In classes as 
nail as four or five no ^eat injustice seems to be done to any 
le unless all the members are very good or very poor, which is 
Jt likely to happen. 
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THE BASIS OF TOOTH PASTE SALES IN BEPRE- 

SENTATIVE COMMUNITIES 



By Donald A. Laird. 

I. INTRODUCTION 

This is a report of a fairly extensive aurvey which was made- 

of two distinct communities with reference to the use and the 
sales of tooth pastes and similar preparations. The aurvey wa» 
made by a class in the psychology of advertising as a term pro- 
ject. It was conducted in Laramie, Wyoming, a town of about 
seven thousand inhabitants. The population ia composed in the 
main of retired ranchers, business and professional families, and 
the families of workers in the refinery, plaster mills, Union Pa- 
cific division employees, and a scattering of students. 

It was not attempted to cover the entire town. Rather the aim 
was to select as rigorously as possible certain sections which 
represented unequivocally sociological extremes typical of the- 
Main Street town. One section of the town was chosen for study 
because it represented the elite, contained the residences of the 
better classes, business and professional men, university familiesr 
and a scattering of well to do ranchers who manage their land af- 
fairs from the town. This section was purposely kept small in. 
order to be certain that the families who contributed information. 
for this group were without doubt properly labelled. In a small 
town there is little difficulty in so classifying the townspeople. 

Opposed to this section, the ereme de la creme of Laramie, a 
section was mapped out which contained the colored section of 
the population, a majority of the foreign element, and the un- 
skilled workers in general. This section is commonly referred t^ 
as the West Side. In this report the two groups will be designat- 
ed the Elite and the West Side. 

II. THE SURVEY. 
A house to house canvas was made of the two carefully selected 
districts. For each house information was gathered under the 
following beads: 

1. Street and number 

2. Persons in family (excluding roomers) 

3. Brand of paste used 

4. Why used (flavor, dentist's advice, samples, advertising, 
friends, etc.) 

5. How many tubes used a month 

6. How many in family use paste once daily 
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T. Any other brands used in family 

8. Why others are used 
The canvasera were instructed to pass by any homes which seemed 
by outward appearances not to properly belong in the district 
being surveyed. 

The students were divided into two equal groups, one for each 
section. A student was selected from out of each group to serve 
as section captain in taking charge of the details of the survey. ' 
Several students not in the class requested an opportunity to take 
part in the data gathering. The only canvaser to be thrown out 
of a house was one of these volunteer solicitors who was ejected 
bodily, even though the door-mat read "Welcome!" 

III. RESULTS.' 

A total of 228 families were interviewed. 104 of which were 
from the Elite district. This report is based, however, upon only 
148 families. Some were eliminated due to grossly incomplete 
data, some others were also eliminated from the Elite returns 
because of bad ratings in the local credit bureau. Eighty-one of 
the families to be reported were from the West Side. 

Table I gives the distribution of the families arranged by num- 
ber in the family. 

TABLE I. 

DISTRIBLTION OT KlZli OF FAMILV IX THE TWO DISTRICTS 

Frequency 
Number in family Elite West Side 



10 1 

11 1 

The medium size with the Elite group falls in the 3 interval, 
with the other group the medium falls in the 4 interval. The 
arithmetical mean for the Elite family size is 3.6, on the West 
Side it is 4.1. 

In 67 families in the Elite section there are 54 that make use 

<Spetl-in cniiKiiDH werp Mr. Itob<>r 
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of a toothpaste, at least one member of the family uses it. In the 
other section there are 53 families out of the 81 in which at least 
one member uses tooth paste. On a per cent basis this is 80.6 per 
cent of the Elite families and 65.4 of the West Side families in 
which tooth paste is used. 

It was difficult for many of those interviewed to conscientiously 
states in reply to item 5, how many tubes were used a month in 
the family. In the Elite section there were only 20 families in 
which this reply was recorded. In the other district 45 families 
replied. These families represent 77 individuals in the Elite dis- 
trict and 194 individuals from the West Side. The twenty fam- 
ilies from the Elite group report the use of 37 tubes (full size) 
a month. This is an average consumption of D.48 tube a month 
per individual. It must be borne in mind that this ia per individ- 
ual for whom we have data available. If this included all the 
families it ia quite probable that there would be a zero after the 
decimal point. The West Side families reported the consumption 
of 84 1-3 tubes per month. On an individual basis this is 0.43 
tube per individual per month among those who reported. 

These results are somewhat in contrast. Amon^ all the famil- 
ies interviewed we have found that a considerably larger per 
cent from the Elite district use a dentrilice. But when this com- 
parison is reduced to a comparison of amount used by those that 
do use a dentrilice then the two groups practically coincide. 

Of most interest from the point of view of advertising is wkji 
the users use the particular brand that they do. Admittedly in 
many instances the replies to item 4 were rather forced, for they 
had never given the matter much consideration. Rationalizations 
in forced explanations were undoubtedly very conspicuous. But 
at that the reasons attributed by the users for their use are a 
revelation. Especially when checked up with the chief overt ad- 
vertising appeals that are in vogue in the marketing of these 
preparations. 

Table 11 gives a detailed tabulation of the rcspcnscs t^ ^tem -t. 
It should perhaps be noted in passing that before the solicitors 
went out into the field they were gathered together and instructed 
regarding the data to be collected. They were especially warned 
against suggesting any response other than what might be the 
natural one. In the case of item 4 the suggestions in parentheses 
were arrived at after the group making the survey had tabulated 
their own reasons for using their particular brand of dentrilice. . 
In case it was necessary to give suggestions to the person beine 
being interviewed they were instructed to read the entire list of 
suggestions before letting the subject respond. 
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SEASONS GIVEN FOR THE IKE OF UENTRIPICB. BY BRAND AND- 
SECTION 

Elite Section West Section 



Colgates 19 7 8 1 1 "l 1 28 9 l"2 3 ~0 *0 2^2 

Pepaodent 16 6701020 13 7 320010 

Pebeco 0000X0 OX OSXZOtOO 

Kolynos 30100020 41 011100 

berlain'a 10000001 10 10000 

Chlorax 10000010 00 000000 

Dr. Grave's 10000010 00 000000 

Listerine 10000010 10 100000 

Soda or salt 30000030 11 00000 

Dr. Lyon's 00000000 21 000001 

Nyal 00000000 22 000000 

Totals 13 20 1 4 2 13 1 21 17 7 1 1 3 3 

A comparison of the totals columns shows the difference between 
the two communities in the matter of paste used. The preponder- 
ence of Pepsodent and Pebeco in the Elite section is worth men- 
tioning in passing. There are other interesting but minor differ- 
ences in th« choice of a dentrifice between the two groups. 

When the reasons given for the use of the particular brand are 
examined group differences also appear. The largest difference 
tinder this head is in the advice of the dentists. This appeared' 
13 times in the Elite section, and 1 time in the other section. 
Samples, which had been given the children in school, was given 
as the reason for the start of the use of a particular brand in. 
three homes of the West Side, and not once in the other section. 
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The predominant reason for the use of personal brands was 
that of the flavor of the preparation. Neglecting the no reason 
responses this reason of the flavor being liked has a greater fre- 
quency than all of the others combined. The ratio of 47:29 
between the use of Colgatea and Pepsodent can largely be ex- 
plained on the basis of flavor. Even in the Elite section vrhere 
one would expect to And the consumers influenced by scientific ap- 
peals in advertising we still find flavor predominating over dental 
advice and advertising in the reasons given from this group. 

Undoubtedly the manufacturers are well aware of the Impor- 
tance of flavor in a dentrifice. Their advertising, however, almost 
without exception is directed toward certain scientific sounding 
appeals for the use of their product. When one gets down to the 
reasons given for the use of any particular brand, the scientific 
reason is not mentioned a single time. Undoubtedly it is the ad- 
vertising, based upon the opinions of high dental authorities, that 
has established the rigorous tooth paste habit of Mr. Average Citi- 
zen, whether he lives on the West Side or on Easy Street. Flavor 
on the other hand, seems to be the principle determining reason 
for the use of any particular brand. 

rV. SUMMARY. 

A house to house survey was made of the two distinct districts 
by the students in a class in the psychology of advertising. A 
good and poor residential district was covered. The tooth paste 
habits of the inhabitants was enquired into. It was found: 

1. This is an excellent method of instilling the spirit of scien- 
tific psychological approach to the problems of advertising; 

2. About 80 per cent of the families from the better section 
and 65 per cent from the poorer section make some regular use 
of a dentriflce; 

3. On the basis of individual consumption, there is no signifi- 
cant difference between the sections among those tkat do U8€ a 
dentrifice. In other words, when the tooth paste habit once hits. 
It hits with equal force in both districts; 

4. But, the tooth paste habit does not occur with as great fre- 
quency in the poorer district as in the better class district; 

5. Dentist's advice plays but a very minor role in the use of 
dentrifices in the poorer districts; 

6. In both districts the predominating reason for the use of 
any particular brand is determined largely by the flavor; 

7. School samples play no apparent part in the use of a 
paste in the better districts, they do play some part in the poorer 
district. 



VOCATIONAL TESTS FOR AGRICULTURAL 
ENGINEERS 

By H. E. Burt and F. W. Ives 
Ohio State University 

INTRODUCTION 

The following is a contribution to the development of vocation- 
al norms which are essential for scientific vocational guidance and 
selection. It presents nothing particularly novel in the way of 
technique but gives data for a vocation that has not hitherto been 
studied in this manner. 

It is obvious in the university as well as subsequently that some 
men who undertake ag'ricuttural engineering as a vocation lack 
the requisite ability. Hence the problem of vocational prediction 
ia in point. Moreover this vocation requires more than mere in- 
telligence. Observation and analysis makes it clear that it is to 
quite an extent a question of special ability. So an effort was 
made to devise special mental tests for predicting this ability and 
to standardize them on advanced students in agricultural engin~ 
eering. 

METHOD 

The selection of the tests was based on some preliminary experi- 
ments the previous year as well as upon further analysis of the 
mental factors involved in the vocation. Typical of such factors 
are motor coordination involved in the use of surveying and draw- 
ing instruments, various aspects of attention involved in testing 
farm machinery and taking readings at the proper moment, spa- 
tial perception and imagination involved in planning farm build- 
ings with reference to their contents, and observation and judg- 
ment involved in planning topographical layout or drains. While 
no mental test measures any such factors exclusively, an effort to 
approach such measurement is far better than random selection 
of test material. Some of the tests employed were modifications 
of those used by various investigators and some were devised 
especially for the occasion. Those which proved useful and were 
retained in the final norms will be described below. 

The tests were given, with two exceptions, by means of mimeo- 
graphed blanks. All the blanks were clipped together in a folder. 
The group method was used and each test had a time limit such 
that no subject would quite finish it. Each test comprised two in- 
stallments, — on successive pages or on the same page separated 
by a space and the word "stop," according to the amount of ma- 
terial. At one sitting the first installments of all the tests were 
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given in succession. The following day the second installments 
were given In the same order. It was thus possible to locate cases 
where the subject misunderstood or made a bad start and also (if 
desirable) to correct for attenuation. The order of the tests was 
designed to avoid undue fatigue by interspersing tests requiring 
close concentration and effort with those somewhat less exacting-. 
There were 14 tests used but as several were scored in more than 
one manner, there were 18 different independent variables involved 
in the research. 

The directions were given orally. The first page of the folder 
contained examples of various tests and after finishing one test 
the subject marked the place in the folder with the finger and 
turned back to the example page during the explanation of the 
next. The examples were in most cases designed to allow one or 
two items for practice. The directions were, of course, standard 
and given verbatim but were abbreviated somewhat for the second 
installments. 

The subjects were 43 advanced students specializing in agricul- 
tural engineering at Ohio State University. They were tested in 
two groups during the'winter of 1921-22. They were directed to 
take the examination by the dean of their college so it is safe to 
assume that incentive was sufficiently near a maximum to be con- 
stant. The testing was done personally by one of the writers 
(Burtt). The total time for the tests, including directions was a 
trifle over two hours, i. e. one hour at each sitting. 

The criterion for evaluating the tests consisted of ratings as to 
"ability in agricultural engineering" made by three instructors in 
the department. Ratings were used rather than grades in engin- 
eering studies on the theory that the latter are less apt to reflect 
a man's actual ability. 

The ratings were made on a linear scale of the sort commonly 
used. The names were typed in a column at the left of the page 
followed by five ruled columns of uniform width. These columns 
were headed from left to right "lowest fifth", "next lowest fifth" 
etc., and represented the distribution, on the basis of ability, of 
all the persons pursuing this vocation whom tW judge ^lew. A 
cross was to be placed after each name indicating the student's 
ability with reference to this whole distribution and the greater the 
ability the farther to the right the cross was to be placed. A pre- 
liminary statement at the top of the blank explained this method in 
detail. The ratings were then measured in millimeters from the 
left edge of the left column, thus expressing the judgment 
quantitatively. 

The instructors made their ratings independently. The raw 
figures could not be validly averaged for a given subject because 
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th* judges might differ in the central tendency and scatter of their 
ratings. Conseqoently each judge's estimates were converted into 
the form x divided by mgma, i. e. the deviation of the measure in 
question from the mean of that judge's ratings taken in terms of 
the standard deviation of his ratings. With such converted meas- 
ures the three judges' estimates for a given subject could then be 
averaged to get a combined rating (the criterion). Most of the 
subjects were rated by all three judges but in the case of three 
subjects only one rating was available. 

The next step was the final selection of the tests. The scores 
for the two installments of each test were added together to form 
a single score which was used throughout. Correlation scatter 
plots were then made for each test against the criterion. It was 
found convenient to plot several pairs of variables simultaneously, 
keeping the criterion on the ordinate, aligning the blanks, placing 
a long ruler below the desired row and checking in the proper 
column on each blank for the other variables. Those plots which 
showed by inspection any semblance of correlation were computed 
by the "products-moments" formula. Eight of these were retained 
as showing some promise (the highest coefficient being .47) and 
intereor related and the regression equation derived. 
DESCRIPTION OF TESTS 

Only the seven tests which appeared in the final regression 
equation will be described. There were eight tests in the equa- 
tion but the weighing of one of these proved to be zero. They 
are numbered as they were in the equation but these numbers 
have no ulterior significance. 

Test 2 consisted of a series of small circles (letter "o" on a 
typewriter) in two columns 2^/^ inches apart. Those in each col- 
umn were double spaced on the typewriter with the right column 
R single space below the left. They were numbered alternately 
in the two columns, i. e. odd numbers in the left and even num- 
bers in the right. The subject connected the circles in the num- 
bered order, i. e. drew straight lines from side to side, gradually 
moving down the page. He kept time with a metronome set at 
120, i. e. made a stroke to the right and back again in a second. 
There were 66 circles in the column. The subjects were stopped 
immediately at the moment they should have finished so that if 
they, did not keep with the metronome their blank was incomplete. 
There were two series of this sort on a blank. One was done as 
above described but for the second the page was turned 90 
degrees so that the strokes were up and down. One such page 
constituted an installment of the test. The instructions were to 
■top as near as possible to the center of each circle but to keep 
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time with the metronome. For scoring, a transparent fltencil 
was made with a U inch circle concentric with each "o". All 
strokes the end of which fell within this circle counted one point. 

This penalized those who did not follow the metronome to the 
extent of one point for each stroke they failed to malce. The max- 
imum score was 224. 

Test 3 had at the top of the page a large diagram of a triangle, 
circle and rectangle overlapping in such a manner that there were 
areas comprising all three figures, each combination of two of 
them and each alone. In each of these areas were several symbols, 
— vowels, consonants and digits. The following are typical of items 
which appeared below the diagram : 

1. Vowel that is in triangle but not in circle or rectangle < > 

2. Smallest number in circle and rectangle but not in triangle ( ) 

3. Consonant that is in rectangle circle and triangle ( ) 
There were 14 such items in each installment. The instructions 
were to place In the brackets at the end of each line the letter or 
number called for by the specifications in that line. The time limit 
was 2 minutes for each installment. The score was the number of 
items correct with a maximum score of 28 for the total test. 

Test 4 was Thurstone's "Special Relations B" given in one in- 
stallment only with a 4 minute time limit. The subject was given 
ample time to read the printed directions attached before turning 
to the test. The score was the number of items correct minus 
the number wrong. The maximum score was 39. 

Test 5 comprised lines of digits in apparently random order, — 
65 digits to the line.' The test consisted in crossing out 2 and 
ringing 3 until coming to a 7 and then reversing the process, — 
crossing 3 and ringing 2, — until the next 7 etc. It was ar- 
ranged, however, so that the first reaction after a 7 was always 
a "cross out." The subject knew this so if he became "lost" it Was 
necessary to go back merely to the last 7. There were five crucial 
numbers between each pair of 7's and three such units per line. 
One unit comprised three 2's and two 3's and the next unit two 
2's and three 3's etc. There were six lines in an installment and 
the time limit was 1 minute and 45 seconds. The subject was 
given one point for each correct mark. Furthermore in case sev- 
eral items in a unit were marked the opposite of what they should 
be and the subject had manifestly started the unit wrongly and 
reacted thereafter accordingly, he was given credit for the sym- 
bols thus marked but penalized one point for the initial mistake. 
The maximum total score was 180. 

'A Icsi slii.tlMr r.i tills luix liwn imnii l.y II. A. Ti<opa. Iiut at fnr oa tbe 
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Test G was auditory memory by the method of word pairs with 
logical material. There were three types of word pairs used: one 
type was normal, another comprised words related to agricultm^al 
engineering and a third involved pairs dealing with zeal, Industry,' 
interest in one's work etc. These three types rotated in succes- 
sion through the list. The fallowing is typical of a sequence of 
such pairs: 



letter 




stamp 




formula 




equation 




task 
diamond 




eager 
spade 




liquid 




hydrometer 




strive 




attain 




spider 
engine 




spin 
windmill 




work 

ere 27 pairs in a s< 
ted an installment. 


pleasur.! 
cries,— 9 of each type. 
The instructions wei 


Two such series 
:e to listen while 



There v 
constituted 8 

the 27 pairs were read and try to notice the natural connection 
between the two words. A metronome, somewhat muffled, sound- 
ed one beat a second as a guide for the experimenter. The two 
words read on two successive beats and there was a pause during 
the third beat. The first word of the next pair came on the 
fourth beat. The subject's blank consisted of a series of num- 
bered lines. Immediately after the initial reading of the list by 
the experimenter, the first words of each pair were read with the 
appropriate number, e. g. "I letter, 2 formula" etc. The subject 
wrote after the appropriate number the word that had paired 
with the one in question. Five seconds were allowed for each 
response. The score was the number of words correctly recalled. 
However the three types of pairs were evaluated separately. 
Especial interest attached to the total number of words of the 
agricultural engineering type recalled as compared with the total 
number of normal words recalled. The ratio of the former to the 
latter was the score used in the regression equation. The ratio 
was multiplied by 100 to simplify computation. 

Test 8 was an "information" test comprising items related to 
agricultural engineering. Effort was made to select items that 
would not actually be discussed in the class room but with which 
an alert interested student who read current agricultural engin- 
eering literature would be familiar. Technical journals were 
used considerably in devising such items. The following are 
typical: 
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1. A track laying tractor is used for: ROAD ROLLING: 
PAINTING: MILKING: LAYING TRACKS: PLOUGHING. 

2. The best blower belts are made of: LEATHER: RUBBER: 
JUTE: SILK: HEMP. 

3. Soil stack is a term used in: BOILER FITTING: SURVEY- 
ING: CEMENT MANUFACTURE: PLUMBING: SOIL 
ANALYSIS. 

There were 20 such items in each installment. The subject was 
instructed to underline the one of the five alternatives in capitals 
that belonged in the sentence. The time hmjt was 2 minutes per 
installment. The score was the number of items correctly marked 
and the maximum total score was thus 40, 

Test 9 was a modification of Thurstone's directions test. Parts 
I and 11 had the following directions: 

If the word contains E, A, and R mark it 1 
If the word contains E but not A and R mark it 2 
If the word contains A but not E and R mark it 3 
If the word contains R but not E and A mark it 4 
Parts III and IV had the following directions: 
If the word contains I, N and G mark it 1 
If the word contains I and N but not G mark it 2 
If the word contains I and G but not N mark it 3 
If the word contains N and G but not I mark it 4 
If the word contains I but not N and G mark it 5 
Each part consisted of 40 words of from 5 to II letters selected 
so as to belong to one of the classes indicated. They were 
arranged in 5 columns and each word was followed by a short 
dotted line for recording the answer. There were always an equal 
number of words requiring each sort of response in the "part". 
The subject was instructed to read the directions, look at the 
samples and mark the words in the same way. Parts I and III 
were done in successsion with time limits of 2 and 2'A minutes 
respectively and constituted the first installment. Parts II and 
IV were given likewise as the second installment. The score was 
the number correct and the r 



RESULTS 
The regression equation is as follows: 

X =.0021X +.0195X +.0091X +.0133X +.0128X 
12 3 4 5 6 

+.0070X — .0014X —3.1892 
8 9 

"Where XI is the combined vocational score and X2 — X9 the raw 
scores in the various tests above described. The weighting of 
Teat 7 proved to be zero. The coefficient of multiple correlation 
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B< (nii«i>) of the weighted sum of teat acores and the criterion 
may be computed theoretically from the partial coefficients and 
proves to be .60. By actually weighting the original scores and 
correlating with the criterion the coefficient is .G2±.07. 

The extent to which the various tests contribute to the final 
weighted score may be seen from the following table which gives 
for each test the correlation with the criterion of zero order, e. g. 
rii, and also of the seventh order with all the other tests constant, 
e. g. ri,.»«™. 

Test Zero order Seventh order 
2 .24 .10 



8 .27 .05 

9 .28 —.05 

Testa 5 and (1 apparently carry moat of the load. They have 
the highest coefficients of zero order and also the highest when the 
other tests are constant. Test 7, on the other hand, while being 
fairly good of itself merely duplicates factors involved in the other 
tests as shown by the partial coefticient of zero. 

The correlation between lentx 5 ajid 6 is only .15. A regression 
equation was derived using only these two tests and is as follows: 
X.=.01Z6X,+.0157Xr-2.64. 

The coefficient of multiple correlation Ri(56) is theoretically 
.59 and the same result is obtained by weighting the original test 
scores. Moreover the weighted sum of testa 5 and 6 correlates 
with the weighted sum of teats 2—9 to the extent of .92. So it 
is obvious that the two tests will give almost as reliable a predic- 
tion as the seven. 

The technique of partial correlation involves, of course, the as- 
sumption of linearity of the original regressions. These regres- 
sions were not computed to test this assumption. However for the 
two final multiple correlations of criterion with weighted sum of 
tests the correlation ratio (eta) was computed. In the case of the 
weighted sum of the seven eta for x on y (y being the criterion) 
is .76, while r as above mentioned is .62. Blakeman's' criterion of 
linearity (using his simplest formula) is 2.1. Theoretically if this 
is less than 2.5 the regression may be considered linear. In the 
case of the weighted sum of the two tests eta is .74 and Blake- 
mans's criterion is 2.2. 
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That the ability in question does not consist of mere intelligence 
but IB definitely specialized is evident from the following. All 
the subjects had, on another occasion, taken the University Intel- 
ligence Test — a somewhat modified army alpha. Scores in this 
test correlate with the criterion to the extent of only .16±.10, 
whereas the correspondine correlations for some of the special 
ability tests are between .40 and .50 and for their weighted sum is 
about .60. The regression of intelligence on criterion or vice versa 
is distinctly non-linear, for Blakeman's formula gives values of 
4.9 and 5.9 respectively. It would thus be hazardous to attempt to 
include intelligence in a regression equation of higher order. These 
facts indicate the advantage in as specialized a vocation as agrri- 
cultural engineering of devising tests for the specific purpose in 
question. 

INTERPRETATION. 

If the tests above described are given to an individual for pur- 
poses of vocational guidance or selection it is necessary to inter- 
pret the scores obtained. This may be done in various ways. Tlie 
sum of the test scores weighted by the coefficients of the independ- 
ent variables in the regression equation must of course be com- 
puted. This sum may then be taken as the most probable voca- 
tional ability of the individual and interpreted, relative to the 
norms, by considering the standard error of estimate. For in- 
stance a normal frequency curve may be drawn with this weighted 
sum of test scores as the mean and the standard error of estimata 
as the standard deviation of the curve, or by the use of a table 
of the probability integral the chances may be expressed of the in- 
dividual's ability falling within certain assigned limits. 

It is perhaps better to develop the interpretation in general 
terms. It is possible with any correlation coefficient to derive from 
the tabic of the probability integral a ten by ten fold table which 
expresses for any assigned decile in one variable (test) the probable 
distribution throughout the various deciles of the other variable 
(vocation). Such a table may be used to predict what per 
cent of the persons in a given test decile will be in any voca- 
tional decile, or to predict for a given individual who scores in 
a certain test decile his chances of being in any vocational decile. 
The table below represents such a distribution for a correlation of 
.60. Some slight adjustments were made to avoid unnecessary de- 
cimals. In the columns at the left are given the limits of the de- 
ciles of test scores. The first column gives such limits for the 
weighted sum of the seven tests and the second column for the 
weighted sum of the two tests in the shorter regression equation. 
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Teat deciles Vocational deciles 

Seven tests Two tests 123456789 10 

42 20 13 10 6 4 3 1 1 
20 20 16 13 10 8 6 6 2 1 
13 15 16 13 12 10 8 7 6 1 
10 13 13 13 13 11 10 8 6 3 
6 10 12 13 13 13 11 10 8 4 
4 8 10 11 13 13 13 12 10 6 
3 6 8 10 11 13 13 13 13 10 
1 5 7 8 10 12 13 16 15 13 
1 2 5 6 8 10 13 15 20 20 
-.80 to-? -.64 to-? 1 1 3 4 6 10 13 20 42 

For example suppose &n individual scores .66 in the sum ot me 
seven tests. This places him in the second highest decile. Then 
the chances ore 20 out of 100 that he will be in the highest decile 
in the vocation, 20 out of 100 that he will be in the next highest 
vocational decile, 15 that he will be in the third decile, 13 that he 
will be in the fourth, 10 in the fifth, etc. By a decile of voca- 
tional ability is meant of course ability like that possessed by the 
given tenth of the group of students on whom the tests were 
standardized. A general table like the above is preferable to the 
scatter clot of the final R of multiple correlation between weijtht- 
ed test scores and criterion because it gives smaller increments. 
The above example is typical of the use of the tests for voca- 
■ tional guidance. It makes it possible to tell the student something 
about his chances of success in this type of work If the tests 
are to be used, on the other hand, for vocational selection it is 
necessary to select on the basis of the above distribution table a 
critical test score and admit to the agricultural engineering course 
only those who exceed that score. The probable calibre of stu- 
dents admitted or rejected on the basis of such critical score can 
be determined from the table. If, for example, those with a 
score algebraically less than-.80 are rejected the expectation is 
that none of the highest tenth of vocational ability has been re- 
jected but that 42 per cent of those rejected are in the lowest 
tenth of vocational ability. 

Summary 
Mental tests were devised for the purpose of predicting ability 
in agricultural engineering and were standardized upon 43 stu- 
dents specializing in that subject. The tests were given in two 
installments by means of mimeographed blanks, using the group 
method. Eighteen test variables were evaluated by means of 
three instructors' ratings. These ratings were made on a linear 
scaled reduced to the ratio of x to sigma for each instructor and 
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these converted measures averaged for each subject. The final 
selection of tests was based on inspection of scatter plots for the 
18 test variables against the vocational variable. Eight tests were 
retained, correlated with the criterion, intercorrelated and the re- 
gresBion equation derived. 

The correlation between the criterion and the sum of the eight 
tests weighted according to this regression equation (one weight- 
ing was zero) was about .60. However two tests carried most of 
the load and when weighted according to a regression equation in 
three variables their sum correlated with the criterion almost as 
highly as did the eight. Intelligence, on the other band, had a 
correlation of only .16 with the vocational variable, which gave 
further justification of the effort involved in devising special 
ability tests. 

Por interpreting the results of the tests when given for purposes 
ol vocational guidance or selection a ten by ten fold table for the 
correlation of ,60 and its standard error of estimate was derived 
from the probability integral. Knowing ai individual's weighted 
test score it is possible with such a table to state the probability 
of his attaining any assigned degree of ability in agricultural en- 
gineering. 
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Third Annual Educational Qonference Conducted By The 

CoLLECE OF Education, Ohio State University, 

On April 5, 6 and 7, 



Nearly 3,000 Ohio educators took advantage of the opportunity 
to attend the Third Annaual Educational Conference which' the 
College of Education, Ohio State University, conducted at Colum- 
bus on April 5, 6 and 7. This attendance marked a decided in- 
crease over that of 1922 and emphasized, quite graphically, the 
increasing interest which the school people of Ohio are showing 
towards these yearly conferences. 

Three general meetings, 24 sectional meetings, and several ex- 
hibits were lumped into the three-day gathering as the forma] as- 
pects of the conference. In addition to this array, however, there 
were many informal luncheons and dinners of various groups 
■which were so successfully attended and so thoroughly appreciated 
that they threaten to become a regular feature of the conference. 

The keynote of the conference was that of "Objectives in Educa- 
tion" and all of the meetings were guided by this in their discus- 
sions. The summary of the meetings which will be published at an 
early date are expected, therefore, to be a valuable contribution to 
the literature on educational objectives since the discussions 
touched on all phases of education as well as on the field as a 
whole. 

One of the interesting sectional meetings was that conducted by 
Dr. H. H. Goddard on Clinical Psychology. Dr. Goddard presided 
at the meetings and conducted a Clinic on the examination and 
diagnosis of children. Children from the Columbus schools were 
used as subjects. Mabel R. Fernald, director of the vocation bu- 
reau, Cincinnati, spoke at this meeting on "The Service a Clinical 
Psychologist Can Render the Public School Teacher," and the 
"Value of the School Psychologist in Personal Work With Pupils" 
was discussed by H. Austin Aikins, Western Reserve University, 
Cleveland. 

Other sectional meetings which were held were: biological 
science, commercial education, educational and intelligence teats, 
educational and intelligence tests demonstration, European history. 
high school principals' association, Latin, mathematics, parent- 
teacher 'a association, teacher training, American history, art, 
city superintendents, county superintendents, elementary princi- 
pals, elementary teachers, English, home economics, industrial and 
vocational education, junior high school principals, modern lan- 
guage, non-biological science and physical education. 
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One of the attractive features of the Conference was the array 
of speakers of national reputation who spoke at the ditferent meet- 
ings. Among these were: W. C. Barley and S. S, Colvin, Teach- 
ers College, Columbia University; C. H. Judd and Algernon Cole- 
nan, University of Chicago; L. V. Koos, University of Minnesota; 
'': A. Works, Cornell University; J. C. Miller, Indiana University; 
■ nd E. W. Barnhart and F. W. Ballou of Washington, D. C. 

One of those chiefly responsible for the Conference has ex- 
ire ssed himself as follows: "The remarkable attendance is most 
' ncou raging to us in this undertaking to make the Annual Educa- 
' ional Conference a vital factor in the life of the Ohio school sys- 
' em. And the concentration of all the meetings on the problem of 
'electing clear-cut objectives has meant a clarifying of the aims 
>vhich the Ohio school people are using as a working basis in the 
'moulding of this system. 

"We were especially gratified this year by the participation in 
our educational program by people whose interest is not primarily 
educational, such as the business men who aided in the discussion 
before the commercial education and the industrial and vocational 
educhtion groups, and too, the meeting conducted for the parent- 
teachers' association. This gives us a definite point of contact 
with the people who are supporting the school system and their co- 
operation makes it easier for us to plan and conduct our work 
with greater effectiveness." 



BOOK REVIEWS 

Knight DUNLAP, The Elements of Scientific Psychology. St, 
Louis, C. V. Moaby Co. 1932. 368 pp. Price. S3.-50. 

In this book Prof. Dunlap haa attempted to sift from the great 
mass of psychological material that essential residue which will 
be needed by the student of scientific psychology when he comes 
to deal with the world of "real objects and real activities." While 
in no sense an attempt at applied psychology it is a very decided 
attempt to present the facts of psychology in such a way that 
their application will be possible. The book is intended primarily 
for college students, but the author assumes that it will also be 
found useful to the general reader who desires to know the fun- 
damentals of psychology but has no teacher. 

The general content of the book may be inferred from the 
following resume: An introduction dealing with the nature and 
divisions of psychology; four chapters dealing with sense per- 
ception, the senses, and sensory qualities; two chapters or sensory 
relations and sensory measurements; two chapters on thinking 
and thought processes; one chapter on the bodily mechanism; two 
chapters on reactions and reaction types; two chapters on per- 
ception; one chapter on affective processes; and one chapter on 
the empirical self. Two appendices complete the book: the first 
deals with mental deficiency and mental disease, the second with 
choice references grouped under certain general divisions. 

The following views gleaned from various parts of the text 
illustrate the author's typical attitudes: Science must be scrupu- 
louslv exact in the use of its terms, and must furnish experi- 
mental proof for all accepted hypotheses. Anecdotal evidence is 
the bane of pseudo science. The term sensation is replaced by 
the term sentienduin as being less confusing. Stimuli are classi- 
fied as physical, unresolved (without mathematical expression,) 
and inadequate (unusual.) All sapid substances must be soluble 
"in water." Classifications of odors based upon the method of 
exhaustion are futile, a more hopeful method will follow more 
nearly the chemical method of Ramsay. Color vision is based on 
a slight modification of the Young-Helmholtz theory, the elemen- 
tary colors of which are red, blue, and chlor (yellow- green.) The 
pigmental cells of the retina protect the receptors from too great 
stimulation in strong illumination. Pitch is the extensity charac- 
ter of tones, and depends upon the degree to which the entire 
tectorial membrane is excited. Pitch differences at first imprecep- 
tiblc are readily preceptible after sufficient practice. The ampullar 
and vestibular receptors of the ear have no true sensory function, 
but give rise only to refiexes in skeletal muscles. Weber's law 
is responsible for the failure to determine many much needed 
constants of range and threshold values. The term conditioned 
refiexed as frequently used is a misleading term. The contrast 
between instinct and habit has been overatressed in the past. 
Intelligence is a term having many meanings, and as far as it 
relates to intelligence tests may be defined as "whatever intelli- 
gence tests measure." Sound localizations in the median plane 
of the body are made possible by timbre alone. The semi-circular 
canals are of doubtful function in equilibration. The eye is blind 
during the saccadic movements of the eye, as in reading. Mean- 
ings do not essentially depend upon muscular movements. Asso- 
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elation is only a special case of habit formation, and occurs in 
exactly the same way as does all serial connections. 

Throughout the book the author is vigorous and stimulating; 

his langruage is not involved and one cannot avoid catching his 
viewpoint whether he agrees with it or not. While the author has 
given credit to all authorities cited he has not done so in a 
way which would permit the reader to refer to the original sources 
without considerable difficulty. This omission might be a serious 
handicap to the general reader who knows little of the psycholo- 
gical literature, in fact the serious student of psychology would 
feel a little more at ease were the opposing views set aside with 
more opportunity to investigate the sources of authority. All in 
all the book is well worth reading because it is so different from 
the usual presentation, if for no other reason. 

Ohio University C. H. Ghowdon. 

Robert MacDougall, Ph. D„ The Genei-al Problems of Ptg- 
ckologii, The New York University Press, New York City, 1922, 
pp. 4G4. 

That applied science must be grounded in solid general scien- 
tific principles is obvious. Almost as obvious is it too, that general 
science must be based upon satisfactory methodological principles, 
although this latter situation is frequently overlooked. Too much 
by far of our scientific work is conceived and executed with faint 
or no regard to the indispensable methodological background. In 
consequence our science is not nearly so free from serious de- 
fects as it might be. 

In psychology especially must the methodological background be 
constantly kept in mind, for not only is psychology concerned with 
phenomena which are the mo.st difficult of any to investigate, but 
also psychological science is, more than any other, a direct de- 
rivative from more elementary ways of thinking. 

To the thoroughgoing analysis of the methodological perspective 
of psychology Professor MacDougall devotes tne present volume. 
- Very clearly does he point out how serious and obstructive are 
the misconceptions which arise when psycholoRists are not fully 
oriented with respect to the nature and purpose of the concep- 
tions guidinR their work. "The individual may be an acute ob- 
server or a patient scholar, but, if the guiding assumptions of his 
work be mistaken, the force of every gift he possesses further 
subverts the purpose of research and hinders progress. The 
work done under such conditions is not merely negative. It ia an 
obstacle set in the way of knowledge, whose Keriousnes:; is propor- 
tionate to its bulk." 

The more positive results derived from a thorough acquaintance 
with the methodological presuppositions which the psychologist 
uses, not only make for rapidity and security of scientific advance, 
but also insure the avoidance of insidious misconceptions. Pro- 
fessor MacDougall in the following quotation enumerates some of 
these misconceptions which have been made in the past. "The 
mind's activity is not determined by a sufficient body of induc- 
tions to make its speculations rational. Fantastic hypotheses are 
shaped. Gross perversions of the meaning and scope of science 
arise. Methaphysical and theological concepts invade ita terri- 
tory. The thinker turns from the patient exploration of fact 
to spin deductions from a system of a priori definitions. Fact 
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and myth are interwoven in a new unitary complex. The natural 
connections of cause and effect are supplemented by essences 
and forms, magic and miracle, as method shifts unpredictably 
between theological interpretation and explanation in terms of 
natural law," 

The treatment which Professor MacDougall gives to the general 
problems of psychology is at once comprehensive and thorough. 
He discusses rot only the relation of psychology to knowledge 
in general and to the arts of life, but the field, the limits, the 
methods, data, and specific problems of psychology. It is not 
necessary to be in full agreement with Professor MacDougall to 
appreciate that this book is of considerable importance and well 
worth the perusal of every serious student of psychology, 

A, A. RoBACK, Bekaviorism aiui Psychology, University Book- 
store, Cambridge, 1923, pp. 284. 

As its title indicates "this book has had for its purpose the 
confutation of the claim of behaviorism to the title of psychology," 
Although the author summarizes his destructive efforts in the 
fallowing statement, that statement does not convey in full force 
the severely critical judgment he really entertains of the behavior- 

"I have tried to show that (1) the concept of behavior is too 
^neral to afford us the foundation for a separate science, (2) 
behaviorism, in its restricted sense, seeks arbitrarily to dominate 
a field which is not, ej: kypthesi, under its jurisdiction by bowing 
out of court everything which does not fit into its narrow frame 
work, and (4) behaviorism docs not readily lend itself to appU- 

How then is the work of destroying such a "general" and worth- 
less movement as behaviorism carried out? Briefly, by putting all 
the behaviorists into one group and attacking all through what 
the author considers the weakest point in each of the very few 
that he slightly examines. 

Similarly, behaviorism is deprived of all applicational value 
by the simple method of assuming that only mentahsm is psycho- 
logy. In consequence of this fact, it is asserted that if one wishes 
to handle situations involving intention, belief, intelligence, ideas 
and emotions, or other such psychological facts, behaviorism can- 
not be of any service at all. 

Indiana University. J. R. Kantor. 

Edward Allsworth Ross, The Social Trend. Century Co., New 
York, 1922, pp. xxii and 235. 

War, prohibition, "philanthropy with strings," women in the 
home and in a man-made world, migratidn, the vanished frontier, 
the birth and death rates, a legal dismissal wage: such are some 
of the topics considered in this collection of papers. It were vain 
to call it a book. 

Written with all the very great attractiveness of Professor 
Robs' style, fearless, Ailed with interesting views, the volume 
deserves a wide reading. 

Perhaps none of these papers is more acute than the one on 
"The Legal Profession from the Social Point of View" or the fol- 
lowing one on "The Conscience of the Expert." It is shown that 
the skill of able lawyers retained by the wealthier, and when 
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wrong more reckless side, tends to whittle down the defensea 
of the law. The lawyer is in large measure engaged in an anti- 
social undertalting. Compare with him the true expert, the product 
of modern training in scientific method, possessing the scientists 
love for truth and you have almost a complete antithesis. The one 
aims to establish a point of view, his side, whether true or false, 
against the assaults of his brother lawyers; the other to wrest the 
truth from nature and report it. Society should and will make 
more use of the scientific expert, not so much because he has a 
special method or special knowledge, but because he has a con- 
science sensitive to truth. So be it. 

All of these papers deserve inclusion in the collection and their 
very variety serves to indicate the diversified social trends of a 
complex social order. 

B. F. Haucht, The Interrelation of Some Higher Learning Proe- 
eses. Psychological Monographs, Whole No. 139. Princeton, N. J. 
Psychological Review Co. 1921. pp. vi and 69 

This is a study, with very complete statistical discussion, of 
some so-called higher learning processes, "rational learning," 
"checker puzzle," "Tait labyrinth" and others, and a comparison 
of the results of these with the results from the Stanford -Bi net. 
The intercorrelatior.? are low and conflicting and the conclusions 
are therefore adverse to the Spearman "Two Factor Theory" of 
intelligence. Are logical conditions and factors in learning on the 
whole less determinative than such matters as emotional stability 
or disturbance, perseverance, self-control and so forth? 

The Professional Education of Teachers hi ClevelajuL Cleveland, 
Ohio. Division of Publications, The Board of Education. 1922. 
pp. X and 92. Price $ .50 

We have here the report of the Educational Commission which 
was appointed to study the subject named in the title. This Com- 
mission was composed of Professors W. C. Bagley, J, W. Withers 
and Geo. C. Chambers. The pamphlet discusses and makes rec- 
ommendations on the affiliation between the Cleveland School of 
Education and the Western Reserve University. It considers ad- 
mission, organization, curricula, finance and other problems and 
gives in appendices a number of documents which show require- 
ments and organization of this important joint venture in the 
pre-service and in-service training of teachers for a great city. 
The report is an important contribution to current discussion of 
teacher training. 

R. G. Jones, Survey of Department of Instruction of the Cleve- 
land Public Schools. Cleveland, Ohio. Division of Publications, 
Board of Education. 1922. pp. 29. Price S .50 

This is the first of a series of continuous surveys to be conducted 
by the Department of Research of the Cleveland Schools, It 
provides a brief analysis of the educational operation of the 
school system. There are diagrams and tables on enrollment, pro- 
motion, age-grade conditions, achievements in individual subjects, 
the work of the psychological clinics, etc. The material was pre- 
pared under the direction of Dr. W. W. Theisen. 

Arthur I. Gates. The Psychology of Readiva and Spelling, 
viitk special reference to disability. Teachers College, Columbia 
University Contributions to Education, No. 129. New York, 
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Teachers College, Columbia University, 1922, pp. viii & 108. 

It is sixteen years since Huey published his excellent summary 
of the psychology and pedagogy of reading. Since tliat time 
a great quantity of experimental and clinical work has been done 
in the field of reading, speech and spelling; and in consequence, 
it is becoming apparent that the difficulties involved, are only 
now slowly emerging. The solutions are still to be sought. 

The present investigation was carried on at the Scarbrough 
School, Scarborough, New York. "Dr. Gates had the good fortune 
to work with a group of pupils of normal or superior intelligence 
but who yet manifested the reading or spelling difficulties which 
form the subject of study. A number of group testa of general 
mental ability, of achievement in school subjects, of responses to 
a variety of visual and auditory stimuli and of several sensory 
mechanisms and motor responses were given to a group of one 
hundred pupils in grades III to VIII. Detailed individual tests 
of mental ability, as the Stanford-Binet, and of specialized abili- 
ties in pronounciation, word perception, etc., were also given. The 
investigation was carried out with considerable detail and great 

In a short review it is impossible to make any adequate report 
of the study. In the first part of the volume it is shown that 
there is an ability common to reading, the recognition of correct 
spelling, proof reading, and the ability to detect differences be- 
tween pairs of similar words. It would seem that both for pre- 
diction and for diagnosis the value of any one of these testa is 
minimized by the fact that they are applicable only through the 
use of material which has already been learned; and that the 
worth of showing that there are psychological elements common 
to reading and proof reading, for example, is not great. 

It appears that the most fruitful portions of the study are the 
short reports of individual difficulties in reading and spelling. (See 
pp. 41-42 and 66-67, etc.) It may at least be seriously questioned 
whether we will ever get very much further with group studies 
of reading defectives until after we have made more detailed 
and critical studies of a large number of individual cases and 

An interesting conclusion, in view of the work of Huey and 
his successors, is the statement that inappropriate eye move- 
ments are not the cause but only a symptom of poor reading, and 
even then, not the symptom most easily observed, (p. 57) 
• Concluding chapters deal with an analysis of abilities involved 
in speUing and present criticism of various theories of the causes 
of backwardness in reading and speUing. 

Perhaps the most important conclusion of the study — and it 
ia certainly an important one — is that presented in the following 
sentences: ."A case of inability to read affords, frequently, a 
tangle of difficulties that experts from several professional fields 
working together may be unable to disentangle. Such a situation 
portrays clearly the need of a new group of specialists who will 
make the solution of such problems their main work." (p. 106) 

Ohio University H. G. GOOD. 
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Henry E. Jackson, Robinson Crusoe, Social Engineer. E. P. 
Dutton, New York. 1922. pp. 301. Bibliography of more than 
60 titles. 

The author divides discussion into three parts. In part I he 
describes at length the character of Robinson Crusoe. He sees 
in him a typical Anglo-Saxon actuated by the gospel of work and 
of courage. Crusoe is represented as meeting numerous discouT' 
agements from which he tufns unshaken and unafraid. 

In part II the author presents certain essential characteristics 
of the industrial situation as it is found today. The author main- 
tains that the source of the ditTiculty is found in the fact that the 
principles of feudahsm control industry today. Industry fails to 
recognize the equality of man a principle which has been rec- 
ognized for more than a hundred years in politics. He declares 
that industry in this particular is a century and a half behind 
politics. Politically men are equal but industrially the old re- 
lation of lord and vassal maintains. 

In part III the author proposes a solution for the industrial 
problem. In brief he declares that the solution will be reached 
when a new attitude of mind has taken possession of those who 
supply capital and those who supply labor. This new attitude of 
mind must recognize the principle of manhood — the right of each 
individual to a proper return upon his investment whether this 
be in terms of capital or labor. In a word it is a plea for in- 
dustrial democracy. 

The book is full of optimism and faith in the future. The author 
does not attempt to list successful applications of the new doc- 
trine. He is concerned only with the presentation of a principle 
of conduct. His discussion is clear and compels consideration on 
the part of the reader. 



This is a course of study and syllabus for mathematics in the 
Junior High School in Cleveland. 'In this syllabus material suit- 
able for mathematics in junior high schools has been organized 
along lines independent of the traditional organization. In the 
Tth grade graphs, fundamental processes, business forms and 
accounts, equations, and percentage with its applications, are 
outlined. In the 8th grade the fundamental processes of arith- 
metic are further considered and advanced work in the application 
of percentage as welt as intuitive geometry are treated. In the 
9>h grade emphasis is placed upon algebra. In the treatment of 
algebra in this grade one important change from the Lraditional 
sequence has been made; factoring and simultaneous equations 
change places. "This change has been made lirst to stress at the 
outset the equation as the most valuable tool in the solution of 
problems and second to prevent the waste of time to the 9B 
pupils." 

Kline-Carey. The Revixed Meamirinff Scale of Free-havd Draw- 
ing. The John Hopkins Press. 1923. Price J .60. Baltimore, Md. 

This is a revision of the authors' earlier scale for measuring 
free-hand drawing. The revision presents a scale for measuring 
achievement in the drawing from memory of distinct types of 
objects. These objects are: house, rabbit, figure in action, and 
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tree. This has made the merit of furnishing an instrument for 
measuring achievement along special lines. 

Ohio University. W. L. Gard. 

William T. Root, Jr. A Soeio-Psyckological Study of Fifty- 
three Supernormal CkUdren. Psychological Monographs Vol, 
XXXIX, Psychological Review Company, Princeton, N, J., and 
Lancaster, Pa. 

This study of supernormal children was undertaken because the 
author felt the importance of the Superior Child to the state and 
because the lack of information concerning the factors making 
for superiority give the subject peculiar interest. The aims of 
the study are mainly to compare the behavior of the superior 
child with that of the normal child; to note the individual 
differences of the superior mind in methods of procedure, imagery, 
associative and mnemonic devices; the qualitive character of 
their responses; and to try to discover the significance of definite 
systems of training, by incidental education, and the social 
milieu. 

The children for this research were selected from the city of 
Los Angeles. The preliminary selection was made thru the schools, 
newspaper accounts, etc. The final selection was based upon the 
results of Binet Tests scores and special ability along some line. 
Several tests were used in the experiment, such as Binet Letter- 
S<]uare, Trabue Completion Test, Healy-Fernald Construction 
Puzzle, Proverb Test, etc,, and the different phases of mentality 
studied. Not only the Psychological test given to discover the 
mental ability of each child were studied, but the social histories 
were thoroughly investigated. The effects of home life and 
training upon the mental development of each child were carefully 
considered. 

The author's conclusions are most interesting and valuable to 
the research student in this field. Mr. Root has reserved no time 
and energy in stating clearly what he discovered in this work 
with bright minds. 

Ohio University LaVinia Warner. 

Thomas Verner Moore. PEBCY BYSSHE SHELLEY. An In- 
troduction to the Study of Character. The Psychological Mono- 
nograph. Vol. XXXI. No. 2. Whole No. 14, 1922. 

This monograph is an important and stimulating endeavor to 
apply the literary-historical method of psychoanalysis to Shelley. 

In the author's analysis of the mentality of the poet he finds, 
first of all, the "precox elements of negativism and defense." He 
is firmly of the opinion that Shelley's plan of hfe, or its chief 
driving force consists of an "affective drive for an object of 
sensuous love" and an intellectual drive colored by protest. 

In the development of his thesis the writer seems to insist upon 
the idea that the prime dominating motive force of Shelly's life 
was his yearning for a beautiful woman who could unreservedly 
appreciate him and his poetical capabilities. In support of this 
view he draws chiefiy upon Ataator. However, a question of 
once arises as to whether this poem should receive the inter- 
pretation that Mr. Moore appears to give it. Critics have largely 
agreed that in this significantly autobiographical' poem the Poet's 
quest of the lovely maiden may be any poet's quest of ideal 
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beauty — such beauty as is celebrated in the Hymn to IntelUetual 
Beauty. And although one readily concedes that Emilia Vivlani, 
more or leas directly inspired Epipsyekidion, one much prefers to 
give the later poem a spiritual rather than a literal signification. 
Shelley here emphasizes a fact so often expressed by him that a 
poet must ever seek the elusive beauty oi life and poetry and 
that when he attains to such only disappointment and failure must 
ensue. The ideality and unrealized end of the pursuit are the 
agencies impellintr a poet. Had the Poet in Alastor attained the 
aDuring object of his love he would have experienced defeat in 
the verv fact of his realization; only the continuous striving 
toward ner brings richness or reward. 

As a potent influence in Shelley's life Mr. Moore cites the 
poet's relationship with Harriet Westbrook. He finds little justi- 
fication for Shelley's conduct. It is to be admitted that even the 
most enthusiastic admirers of Shelly cannot make an altogether 
satisfactory brief for him. However, it is gratifying to the 
lovers of Shelley to note William Sharp's assurance that Shelly's 
"sorrow and life-long regret for the malfortunate outcome of 
his action were genuine." 

Mr. Moore well points out the element of protest in the poet's 
character. But one questions whether this factor is wholly, or 
even largely, due to the "father complex." One is inclined to 
hold that the Sion House experience, more than any other, en- 
forced, if not implanted, Shelley's hatred of tyranny. Unques- 
tionably there is some difference of opinion as to the poet's home 
relationships; but all agree as to the extreme distress he suffered 
at Sion House. Mr. Moore draws upon the Prometheus myth to 
illustrate his convictions in this instance. 

The Prometheus theme, a very popular one in literature, per- 
haps cannot be summoned to demonstrate anything peculiar to 
Shelley. True the poet employs it as a medium for his expression 
of the overthrow of all forms of tyranny and his installation of 
the Golden Age. Demogorgon, a name which in the drama no 
longer carries any connotation of magic, is by the poet defined as 
"Eternity." Shelley has not identified him with mere Necessity 
because he too strongly personalizes the character; for instance, 
the closing pronouncement of the last act. The poet's dream 
reaches its most vivid delineation in the eternal union of Love 
and Humanity. 

Chapter IX of Mr. Moore's article contains a brief analytical 
summary of the Shelley profile. It is reasonably comprehensive. 
As has just been indicated one is inclined to differ from the latter 
test against all authority rooted unconsciously in the hatred of 
portion of the second predication, namely, "The bold, violent pro- 
Books and pamphlets for review should be sent to James P. 
his father." Perhaps one might suggest that greater emphasis 
should have been placed on Shelley's generosity of soul. The 
philosophical-religious aspect of the poet's mind has not been 
noted. On an earlier page Mr, Moore refers to Shelley's homo- 
sexuality. Fortunately this is omitted in the profile. It would^ 
be difficult to detect this element in Shelley's mental constitution.' 
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Ohio University Hiram R. Wilson, 

The Honeetj/ Book. Prepared and published by The National 
Honesty Bureau, 115 Broadway, New York. 

A textbook for schools written by business men instead of by 
pedagogues, a good idea. Hitherto the most recent illustration in 
schoolbooks of business honor have been taken from such remote 
examples as Benjamin Franklin and Peter Cooper. This little 
book begins with a talk about a modern office-boy, tells how a 
young man today gets a bond and it is replete with references to 
the business practices of our own time. The National Surety 
Company has originated the plan of reviving the commandment. 
"Thou shalt not steal," in the schools and has had the stories and 
methods tried out successfully in real schools by teachers with 
actual pupils. The stories are crisp, pointed, unconventional and 
avoid the goody-goody. 

The volume is an interesting attempt to demonstrate how a par- 
ticular virtue may be inculcated. Its suggestions give promise of 
being helpful to teachers in teaching other virtues. The book 
and the campaign of which it is the instrument are to be heartily 
commended. 

Ohio University James P. Porter. 
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THE RETURN COUPON AS A MEASURE OF 
ADVERTISING EFFICIENCY 



By a, T, Pofpenberger 
Columbia University 



When the psychologist offers a device for measuring the effect- 
iveness of advertisements, such as the Order of Merit Method, or 
one of the Attention or Memory methods, it should be evaluated 
not in comparison with some ideal method but rather with the 
other actual methods in use with which it would have to com- 
pete. In investigating current methods of measuring advertising 
efficiency the writer was surprised to discover the reliance which 
is at present placed upon the return coupon as a measure of the 
value not only of a particular piece of advertising copy, but of 
an advertising medium which carries the copy. This reliance 
seems not to be limited to cases of strictly mail order selling, 
but is extended to cases where the product may be purchased 
directly in any locality, and where the return coupon concerns 
merely samples or descriptive literature. Publications have been 
known to lose valuable clients because the number of "replies" 
through that medium do not come up to expectations. There 
must be many factors determining whether readers of a particular 
medium will or will not indicate their interest in advertised 
articles by filling in and mailing a return coupon. The price of 
a magazine as well as the nature of its contents, determining the 
character of its readers; its editorial policy such as that of ad- 
vocating buying from local dealers; the distribution of readers 
in city and country; all may give clues to the possible attitude 
of the reader toward the return coupon. In addition to these, 
there are other more strictly psychological factors involved. 
These, like most others which determine the human reaction to 
advertising, can be discovered by painstaking research. This 
report deals with conditions that are not peculiar to any one 
medium, but rather with the elTcctivcness of the return coupon 
in general. Two of these will be discussed, namely <1) the de- 
pendence of effectiveness upon attention value, and (2) the de- 
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pendence of effectiveness upon ease of using the coupon. 

1. A casual survey of any magazine will provide ubundant 
evidence of the lack of attention-getting power in the return 
coupon. Its size is usually reduced to a minimum; its position 
is at the extreme bottom of the advertisement or in a lower 
corner, with none of the customary mechanical devices employed 
to carry the eye to it; its type is small and plain. It would seem 
that a reader might well have his interest aroused in the article 
advertised and yet fail to be stirred to action by the appeal of 
the coupon, or worse still might fail to notice the coupon at all. 

To test the attention value of return coupons in comparison 
with the advertisements that carry them, a simple experiment 
was arranged. Six full page advertisements (black and white 
only) were taken from the October 14 issue of the Saturday 
Evening Post. Three of these contained return coupons of the 
usual sort, while the other three had none- This set of six 
advertisements was presented to 210 persons each of whom was 
asked to examine them as much as he liked, but more carefully 
than he would in looking over a magazine. Immediately after 
this examination was iinished, the advertisements were withdrawn 
and each person was asked to write the names of the articles 
advertised. The test was made extremely easy by using only six 
advertisements and testing for knowledge of them immediately 
after so that as large a proportion of the people tested as pos- 
sible should remember all of them. That most of the persons 
did remember all the advertisements may be seen in column 3 
of the accompanying table, where 189 of the total of 210 re- 
membered the advertisement making the lowest score and 202 
of the total of 210 remembered the one making the highest score. 
It will be noticed that the six advertisements were nearly equally 
well remembered. 

As soon as the names of the articles advertised had been 
written, these sheets were collected, and Others containinsr a 
printed list of these articles were given to each person with in- 
structions to check those articles whose advertisements had re- 
turn coupons. The results of this test are given in the table. 
The first column gives the name of the article advertised, columns 
2, 3 and 4 give the number of persons who recalled each ad- 
vertisement. The scores for men and women are reported separ- 
ately in columns 2 and 3 and are then combined in column 4. 
Columns 5, 6 and 7 give the data for the recall of the coupons, 
5 and 6 giving the records separately for men and women and 
7 combining these into a total score. The first three advertwe- 
menta m the table contained return coupons while the last three 
contained no couponn. The lower right hand corner of the table — 
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figures followed by an ( * ) — represent the cases where ad- 
vertisements were said to contain coupons when they really did 
not. Disregarding the records for men and women separately, 
we find that 30, 65 and 31 persona reported falsely concerning 
the presence of coupons. 'Riese figures indicate the degree to 
which jessing occurred, and furnish the means for calculating 
approximately how much guessing occured in the case of ad- 
vertisements which really did have coupons. This may be done 
roughly as follows: It will be observed that the last three ad- 
vertisements were recalled by 592 persons and of these 116 or 

NUMBER OF RECALLED RECALLED 

PERSONS WHO ADVERTISEMENTS COUPONS 

ADVERTISEMENTS WITH COUPONS 

(1) (2) (3) (4) (5) <6> (7) 

Articles Advertiaed Men Women Both Men Women Both 

Fleischman's Yeast 81 109 190 40 6S 108 

Booth's Sardines 82 110 192 18 31 49 
Underwood Bookkeeping 

Machine 83 106 189 22 33 66 

Total 246 325 571 80 132 212 

ADVERTISEMENTS WITHOUT COUPONS 

Styleplus Clothes 88 111 199 14' 16* 30' 

Squibb's Products 86 105 191 25* 30* 65* 

Apollo Chocolates 91 111 202 12* 19* 31* 

Total 265 327 592 51* 66* 116* 

about 20 per cent said they contained coupons when they did 
not. The first three advertisements were recalled by 671 persons 
and of these 212 or about 40 per cent said they contained cou- 
pons. But some of these persons must have been guessing and 
we may assume that about the same proportion guessed here as 
in the case of the lest three advertisements, namely, 20 per cent. 
Making this correction, it would appear that only about 20 per 
cent of the people who recalled the advertisements recalled whether 
they had return coupons. As our correction for guessing is 
conservative, this 20 per cent is more likely to be too high than 
too low. 

Since the ultimate measure of the value of an advertisement 
is the number of purchasers it creates, the return coupon as an 
indicator of effectiveness should register more than 20 per cent 
of the attention and memory value of the whole advertisement. 
By giving it some of the attention power devoted to the rest of 
the advertisement, it might be made to register more nearly the 
value of the advertisement or of the medium in which it is placed. 
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Certainly if much reliance is to be placed upon the coapon to 
indicate theae values some effort should be made to bring it to 
the attention of the reader. 

The figures in the table showing the records for men and women 
separately both in the recall of advertisements and in the recall 
of coupons show only one difference worth noting. In every case 
the scores for women are higher than for men, a difference that 
is usually noted in tests of this sort. But the proportion of 
coupons recalled to advertisements recalled and the proportion 
of guesses does not differ materially for the two sexes. Likewise, 
no particular significance is to be attached to the difference in 
scores of the different advertisements. They were too few in 
number to enable conclusions to be drawn about the value of 
types of coupons etc. The high coupon score for the Fleischman 
advertisement is probably due to the large element of guessing 
in that case, but this cannot be determined definitely from our 
records. The influence of difference in size, position and layout 
of coupons is a matter which would be well worth investigating. 

^. The second condition upon which the effectiveness of the 
return coupon depends is the ease with which it may be used. 
There are a number of factors that might well be considered here. 
For example, the paper on which the advertisement is printed 
may be too smooth to permit of pencil writing and too porous to 
permit the use of ink without its blotting. Again, if not perforated, 
the coupon may tear in being removed from the advertisement. 
These are difficulties probably inherit in the medium and which 
cannot be remedied. But there is another, which can be more 
easily handled. This has to do with the amount of space allowed 
for writing the name and address on the coupon. A glance at a 
collection of coupons will show that many of them are entirely 
too short to receive an ordinary signature. Now, it may seem at 
first a very small matter to expect the reader to reduce his hand- 
writing sufficiently to meet the coupon conditions. Still, it must 
be remembered that in many cases, if not in the majority of 
them, the decision to react or not to react by filling in and mailing 
a coupon hangs on a very slender thread. The resistance which 
any slight obstacle offers may be just enough to sway the re-action 
in the negative direction. 

A series of measurements was made of a random collection of 
110 signatures, and a series of 435 return coupons, some of them 
from full page and some from half page advertisements in large 
size periodicals such as Tkc Ladies Home Journal and the Sat- 
vrday Evening Post; others were taken from full page and half 
page advertisements in standard size magazines such as Scrt6ner« 
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and the Centurg > MagaziAei The spbces allowed for both the 
signature and the addfess were measured but only the former 'vill 
be discussed. The accompanying chart will show graphically the 
decree to which the spaces fall short of accommodatirg the sig- 
natures. The horizontal scale for every curve represents the 
lengrth of the signatures- and the signature spaces in centimeters, 
and the vertical scale represents the number of cases of a griven 
length. The topmost curve shows the distribution of aignature 
lengths, ranging from about 2.6 cm., to about 11.5 cm,, with the 
median length at 6,9 cm. The sedo'nd curve shows the distribu- 
tion of signature spaeet in coupons from full page advei'tise- 
ments in large size magazines; the third, in coupons from half 
page advert) a erne nta in large si^e magazines; the fourth in cou- 
pons from full page ^vertisemcnts in standard magazines; and 
the fifth in coupons from half page advertisements' in standard 
size magazines. The solid line representing the tnedian length 
of the signatures is carried down through the other curves, whose 
own medians are represented by dotted lines. Although there 
are a few coupons with enough space to accomodate the largest 
names, the median of the names is considerably larger than the 
medians of any of the spaces. The relationship may also be 
expressed in terms of the per cent of the signature spaces that 
equal or exceed in length the median of the signatures. These 
figures are giv^n below.. 

Median % Reaching 
Length or Exceed. 
No. Cases in Cm. Med. Name 
Signatures 109 6.9 20 

Full page Ad. Large Size 133 5.9 20 

Half page Ad. Large Size 65 4.9 20 

Pull page Ad. Standard Size 116 6.0 20 

Half page Ad, Standari}. Size 23 5.3 0<Approx) 

If the distributions of the spaces were equal to those of the 
signatures, there should be 50 per cent of the cases of the former 
exceeding the median of the latter. Thus in three of the cases, 
30 per cent of the names are too large for the spaces, and fn the 
fourth case, they are about all too large to go in the space pro- 
vided. There appears to be an even greater discrepancy between 
the height ol writing space provided and the height of space 
needed for the signatures, although no actual measurements have 
been made to support this statement. 

That the space allowed for coupon purposes is not limited by 
the size of the advertisement is clear from the fact that the coupon 
in the standard magazines tended to be larger than that in the 
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large size magazine, both for the full and half page advertise- 
ments (medians of 6.0 and 5.3 compared with medians of 5.9 and 
4.9). The real reason is to be sought in the failure to recognize 
the importance of providing adequate space. Adults have their 
writing habits firmly establiehed, so much so that writing a aigna- 
tare or an address is quite automatic. Interference with the 
smooth flow of the automatic responses when once begun, arouses 
resistance and an unpleasant feeling-tone. This is illustrated in 
the well-known Downey tests for character traits in which the 
subject is asked to reduce, enlarge or otherwise alter the character 
of his writing, and in which the measure is in terms of resistance 
encountered in complying with the instructions. Now, it is just 
this unpleasant feeling-tone which the advertiser tries in so many 
other ways to avoid, -e.g. by the use of beautiful illustrations, 
beautiful color combinations, graceful border treatments, appro- 
priate type faces, etc. The coupon, if it is to be relied upon or 
used at all, should certainly not be permitted to defeat its own pur- 
pose or the purpose of the whole advertisement by allotting too 
little space to it. 

This brief study points to three conclusions, namely, that the 
return coupon cannot adequately measure the effectiveness of an 
advertisement or a medium, except in direct mail selling, because 
of the complexity of factors on which reaction to it depends; that 
as nsed at present it lacks sufficient attention-getting power to at- 
tract more than a small portion of the readers of the advertise- 
ment; and that in the size in which it most commonly appears it 
is likely to create an unpleasant feeling-tone because of inadequate 
space allowed for writing. 



FLUCTUATIONS IN MENTAL PRODUCTION WHEN 
MOTIVATION IS THE MAIN VARIABLE 



By F. B. Knight and H. H. Remmers 



GAP BETWEEN POSSIBLE AND ACTUAL PRODUCTION 
IN COLLEGE STUDENTS 

No one knows with useful accuracy just how great is the sap 
between the potential capacity of a college student and his ac- 
complishment in college courses. There are, no doubt, many stu- 
dents who, if we make a rough use of Franzen's Accomplishment 
Quotient, possess 100 units of potential capacity and whose ac- 
complishment in college work is appropriatbly 100 units. These 
are efficient students, for there is a negligible gap between potent- 
ial power and mental production. On an invested capital of abil- 
ity the yield is satisfactory. 

There are other students who possess say 100 units of capacity, 
but whose mental production is 80 units, or 70 units, or even prob- 
ably 50 units. These students do not do as much as tbey should 
when their ability to work is considered. We might very well 
suppose that three students have 100 units of potential power 
each, and one of the three turns in 93 units of work; another 84; 
and the third 70 units. The second and third are not then doing 
the amount or quality of work we can fairly expect in the light 
of their potential capacity. They are not doing mental work ef- 
fectively. 

In our high schools we are rapidly getting our requirements for 
individual students on a scientific basis. Pupils with approxi- 
mately equal mental ability must do approximate work. The same 
quantity or quality of work to be produced by three pupils, say 
80 units in each case, is not estimated a "B" for all students ir- 
respective of their difference of ability. A student with 120 units 
of ability who hands in 80 units production may be failed, whereas 
80 units of production by a student of 100 units of capacity would 
be judged as creditable work, and one of 80 units production with 
an 80-unit mind should receive definite commendation for his 

The college instructor is a genuine teacher to the extent that the 
gap between potential power and actual accomplishment in each 

'or oiiirHo n'o ilo not iiu'in tili>rullj Ihnt iat 
thnuKliI <■{ us n collpclli'ii uf iinltii. Thin phrui 
tliDl cliff<-ri.'n(.i'K in lulcUiTtual nliUlIi'. iinil Ihu reimion oi i 
in criltcRu work is of imiiortiinci-. Neither can we dpsprlbe 
IcrniK ni iiiiiiH, It would IK' a cicnr euId it we cuuld. Tli 
tiie rrl.itlv.- cfflclom-jr of KtuilPntn' work, dlltfrfocps of 
counted in. In Ix-ttiT Ihnn coDBlOcrstlonii ot work (llffcrFDce o 
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one of his pupils is small and tends to grow smaller. That wide 
^DB of this kind exist in most students in the average college of 
liberal arts could probably be neatly demonstrated if time and 
money for such a research were available. 

WHY THE GAP EXISTS 

The size of this difference between what a student could do and 
what he does do is a function of many factors, among which are 
undoubtedly, (a) the irrelevance of the subject matter to the pur- 
poses of the student, (b) the successful competition of many extra- 
curricular activities, (c) the inadequate manipulation of the laws 
of learning by the teacher and the like. 

Now the laws of learning or the laws of correct teaching operate 
as truly in the college classroom as they do in the primary school 
or the eighth grade. )Lack of sound pedagogy in the classrooms of 
a university can not he defended on any ground.) In fact there is 
a growing realization on the part of many that skill in teaching 
as teaching must be highly prized and honored by college admin- 
istrators. 

Instruction on "How to Teach" is being provided for the younger 
members of several University staffs already. 
DATA ON ATTENTION 

One of the necessary conditions of learning is attention of a 
high level on the part of the learners. It may be properly asked, 
"What are the attention habits of college students?" 

The following data may be interpreted as very strongly sug- 
gesting that one reason for the gap between what could be done 
and what is done by college students is that the kind of attention 
(or lack of it) given by students in the college classroom hinders 
if it does not make impossible, rapid or accurate learning. If in 
this simple chart, line A means a very low degree of attention; 
line B means the kind of listless, passive attention that one gives 
to familiar surroundings while riding; line represents a rapt 
attention, such as one gives to the reading of a telegram or to 
the tense crises in a foot-bnll game we can see that the amount 



of time spent in a recitation or lecture with attention of A type 
or B type ia really but little more than time out. The kind of 
learning required in college work takes place rarely if ever except 
when the matter in hand is attacked with type C attention. What 
per cent of a 50-minute recitation is spent by a student giving 
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type C attention? What per cent type B or type A? No one 
knows, and of course the individual variations are very wide indeed. 
A student does not know with accuracy the amount of time spent in 
the subject matter with these types of attention. His opinion, 
though, is probably better than a piess. On the whole he is apt 
to report the matter with errors favorable rather than unfavorable 
for himself.' 

The writers selected groups of college juniors for study. The 
students were on the whole among the "better sort." Their opin- 
ions concerning the kind of attention actually paid in classroom 
work is reported in the following tables: 
TABLE I 
Distribution of Kinds of Attention in P^ cent of Total 
Recitation Time for Cultural Courses, 
Ck>u.BGE of Liberal Arts 
% A B C 



A, B, and C refer to kind of attention as defined in context; % 
refers to % of average recitation. To be read five students thought 
6% of the recitation time involved type A attention; nine students 
thought 10% of the time involved type A attention, etc. 

These distributions give a spread of the type of attention juniors 
give in the average recitation. The central tendencies are: (1) 
that high, effective attention, type C, is given 159E>-20% of the 
time; (2) that a lower, less acute attention is given 655&-G0% of 
the time; (3) that between 15%-20% of the time practically no 

'For data on tbf unconsi-ious tendenc/ of over -estimation »ee: Pitfalls 
and Rutlng Scbemcs, Knlgbt-Frann^n (Journal of Educational 
Uar. 1II22.I 
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attention ia given at all. Little learning can go on when atten- 
tion of type A or B is given. Obviously a central improvement in 
college inBtruction would be to make those changes in class pro- 
cedure which would tend to cause a large percentage of recita- 
tion time to involve that type of attention which is essential to the 
learning process. 

When we have a group of students in the college of commerce' 
estimate the percentage of time in the recitation given to the three 
types of attention, we get a slightly different result. The central 
tendency of the lowest kind of attention drops 5%. The middle 
60-60 type of attention takes up about 50% of the time. The ef- 
fective type of attention is the rule about 25g{i of the time, slightly 
higher than in orothodox cultural courses. These data are spread 
in Table II. 



TABLE ir 
College op Commerce 



When, however, we go over into the definitely vocational c 
of law, medicine, and engineering, the opinion of the students as 
to the kind of attention paid in class is in startling variance with 
comparable opinion of students in the college of liberal arts. Data 
on 50 law students is spread on Table III. 

■Read tbe BBme aa Talilo I. 
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TABLE III 
Law College 



95 

Summary of these data: The drift toward effective attention 
habits 13 significantly paralleled by drift in curricula toward voca- 
tional content. This means, in the opinion of the writers, nothing 
more or less than conscious motivation causes large fluctuations 
in mental production. 

A SECOND INVESTIGATION 

The above data are worthy of consideration despite the absence 
of objective measures of mental production. We now will de- 
scribe an experiment in which adequate objective data further 
support our contention. 

THE SLBJfXTS OF TUB EXI'EBIMEST 

The subjects of this experiment were ten college freshmen who 
had been subjected to a strenuous regime of humiliation and 
fatigue duty during their probation period as pledges of a fra- 
ternity. A brief summary of this regimen ia in order here. 

The first day of probation each one of the ten subjects was 
given a rather strong dose of physic (two Hinkle's pills). They 
were rot permitted to shave or bathe during the entire period of 
probation. A fake branding, very realistically carried through, 
which, according to the testimony of the chairman of the initiation 
committee was obviously a considerable mental shock, was a part 
of the program. Each freshman had to carry with him wherever 
he went some rather weighty or bulky article as a brick, a pul. 
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a piece of gas-pipe, etc. Beaidea these quantitatively rather im- 
measurable indignities, which further included onerous doses of 
"paddling" with barrel-stave a, the eating of raw liver (ostensibly 
dog-meat) sprinkled with asafoetida; the application of embar- 
rassing, rather humiliating names to the pledges, etc., perhaps the 
more significant features from the point of view of this experi- 
ment are that the men were permitted to sleep only from one to 
two hours out of every twenty-four, and that during each of 
their twenty-two waking hours they were compelled to do menial 
or nonsensical tasks about the house, or more frequently to go for 
long hikes of 12 to 15 miles. In addition to all this, they were 
required to attend to their regular university work. 

The probation period began on Monday, and the experiment to 
be described here was carried out on the following Friday late at 
night. Here we have a group of workers, fatigued, harassed, and 
working at a time when the social customs of a college campus 
make work unusually distasteful. Eagerness for entrance to 
the fraternity was ostensibly related to scores made during 
this work period. Thus the cards were stacked against this group 
except for motivation. 

A few days later a group of 54 college juniors (mostly women) 
were given a similar but shorter test on the same material as a 
means of securing comparable data from "normal" individuals. 

Comparison of scores made on intelligence tests showed no signi- 
ficant differences between the two groups. The juniors were 
working under good conditions but with no special motivation. 
Thus the cards were stacked in their favor for no motivation 
other than those operating in a normal college recitation. 

MATERIAL AND PB0CEDI;KK or THE INVESTIGATION 

The materials used were the Thorndike addition sheets, each of 
which has forty-eight columns of ten addends with I's and O's 
omitted. "Any successive five of the columns are of a difficulty 
nearly, if not exactly equal.'" These sheets were arranged in pads. 
There was no possibility of the subject's remembering the answers, 
for there was no possibility of identifying the seven different 
kinds of sheets. 

Our handicapped but motivated group was told by a member 
of the fraternity that they were to assist in a scientific experi- 
ment and that they were to push themselves to the limit as scores 
on the testa were involved in final election. Desire to qualify for 
the fraternity was the motivation. The attitude of the group as 
a whole was one of cordial co-operation. At the signal "Go!" 
they were to begin adding and to continue until a signal "MarkI" 
was given. This was done at the end of every five minute period. 

•See Garth, T.R., Mrntal Fuflcur, Arclilvos of Pfych. No. 41, August, 1018. 
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Twenty-four such five-minute work perioda were jiven with a ten- 
minute intermission at the end of the first twelve periods, &t 
which time the subjects were given lig:ht refreshments. The 
"Mark" signal was for the purpose of getting an introspective 
check on the feeling-tone of the subjects as well as to meBsure 
progress by units of time. They were told to mark A, B, C, D, E, 
or F, where A-autnified a feeling of gcneraL wcll=bei ng. no nega- 
tive feeling-tone or discomfort; E_s«s to be given the significance 
of in tense aversi on or high negative feeling-tone; C was to mean 
a rather neutral, don't-care-one-way-or-another attitude. Damg 
the last three periods a strong effort was made to obtain an end 
spurt by urging the men to put all they had in them into the work. 

AVERAGE AND INDIVIDUAL SCORES OP THE TEN TIRED 
FRESHMEN ADEQUATELY MOTIVATED 

The raw data give a composite work curve that is very nearly 
a straight line (See Figure I) for both the total amount done and 
the amount correct. Nor is there any noteworthy falling off in 
accuracy. The data from which this curve is constructed are 
shown in Table L° The last five-minute period does show a 
smaller per cent correct than do any of the other periods, but the 
difference is slight. The curve of the percentage correct is shown 
in Figure 1 at the top. The straight horizontal line through the 
curve represents the arithmetic mean of the percentile values for 
each five-minute period. Whatever decrease in total amount or 
amount correct occurred may be shown by comparing the work of 
the first 12 periods with that of the last 12. Table II gives the 
data for each person so compared as well as the totals for the 
entire 24 periods. The percentage of correct work for the first 
12 periods is 85, that for the last 12', 83 — a decrease of but two 
per cent! 

The individual work curves are shown in Fig. 2. Perhaps their 
most striking feature is the consistent downward trend in the 
curve of satisfy] ngness and the lack of a significant corresponding 
downward trend in the output. The curve of satisfyingness* — in 
the case of every individual except Pitz — shows' a marked de- 
cline with the progress of the experiment. In his case the inter- 
mission for refreshments proved to be annoying rather than sat- 
isfying. 



•Aa nppearu from the Imilvlduol work currc (Fig. 2) subject B— came 
[our pertiida laie. In order to culculnte everogeg tor the whole froup, bis 
total output wus welgbted with hla avtirRse produrtion per tlTe-miDate 
perlodH for the twebCy porloda that he actually worked. ThU procedure 
would aeem to bi> fnlr. The senernl coDctuBluna are not In an; caae <llf- 
fcreut than tbcy would hnve been without aueh weighting. 
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Showing the amount of work, the amount correct, the amount 
incorrect, and the per cent correct for the ten freshmen in terms 
of columns added per five-minute period. 



Av. per person 21.9 
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TABLE II 
Showing data for 10 individuals in terms of number of columns 
added. 



1 , , 



C D E F 



FJtz 636 


440 


82.09 


Po 490 


429 


87.65 


Gi 666 


603 


88.88 


Har636 


459 


85.63 


Bai 362 


276 


78.41 


An 681 


478 


82.27 


Gr 618 


466 


89.96 


tie 706 


671 


80.99 


Bo 312 


229 


73.40 


DeS464 


417 


89.87 



267 205 279 235 23 1 
247 216 243 213 6 8 



182 136 170 141 13 5 



282 237 299 241 
264 236 264 230 



150 128 



101 



13 3 2 3 

7 6 11 1 
4 14 6 

2 2 6 3 



244 217 16 7 2 6 3 



Av. 606.0 426.8 84. 
, The curves show 



256.6 218.2 249.4 208.8 70 51 46 24 16 15 
wide diverj-enees of amount correct from 
total amount done — -they practically parallel each other from one 
five-minute period to the next throughout the experiment. 

The features of the work curve contended for by Kraepelin and 
his followers are not ia evidence — «t least not consistently for all 
the individuals. There is little if any more fluctuation upward at 
tha beginning or at the end to indicate "Anlauf" or "Schlussan- 
trieb" than chance would account for. Subjects FitK:-, Fo — , 
Des — , Bai — , An — and Gr — show an increase both in amount 
done and amount correct from the first to the second period. Bo — , 
Ne — and Hav — on the other hand show a decrease, while Gi — 
does not change in total amount done. The terminal spurt is no 
more in evidence, notwithstanding an effort to produce one by en- 
couraging and urging the men to increase their speed if possible. 
The amount done shows an upward trend for Pits — , Gi — ,DeS — ; 
Ne — , Hav — , Bai — , Gr — and Bo— however, exhibit a down- 
ward curve. Nor did the intermission cause any uniform change 
in output. 

Fig. 3 shows graphically in another way the relation between 
output and feeling tone. The curves were constructed by dividing 
the total number of A's, B's, C's and so forth, into the number 
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of colnmns marked by each, and plotting these results against the 
letters on the abscissae. If feeling-tone correlated with output 
there should then be a conaistent more or less parallel downward 
trend for the two curves. Some of the curves — those tor Bo — , 
DeS — , Hav — , Gr— , and Ne— , do show somewhat of a downward 
trend. Fo — and Bai — ■ show practically no change; Gi — , however, 
increased markedly in output when his feeling-tone was most neg- 
ative; this is also true to a somewhat leas extent for An — . 

8UMMABY 

The experiment was carried on for 24 five-minute periods — 
that is, two working hours. The ten subjects had a total output 
of S060 columns added, of which 4268 or approximately S4 per 
cent were correct. The average total amount added was approx- 
imately 21 columns per five-minute period per person; the aver- 
age amount correct per five-minute period per person was ap- 
proximately 18 columns. The range of individual achievement is 
from 40 columns attempted with 36 columns correct for subject 
Nel — , to ten attempts and two columns correct for subject Bo — . 
CONCLUSIONS' 

1. A two-hour work period, with this kind of material for in- 
dividuals who are already physically tired, is not sufficient to 
decrease the output to any appreciable extent. 

2. There is little or no apparent relation between feeling-tone 
and amount of work done. 

3. There is no evidence of a warming-up period or of initial 
spurt. 

4. Accuracy is little affected. 

5. In spite of an effort to obtain an end spurt, none was ob- 
tained. 

DATA OP FIFTY-FOUR RESTED JUNIORS WITH ONLY 
CLASS-ROOM MOTIVATION 

The essential facts for this group are shown in Table III. The 
material used for the group was exactly like that used for the ten 
freshmen. Fig. 4 shows graphically the work curves for the group, 
both as to total amount and amount correct for each five-minute 
work period. There is little that is noteworthy concerning these 
data except the very greatly reduced output as compared with the 
freshmen. Possibly this is to be accounted for on the basis of 
class-room 'set' rather than on the ground of less ability in adding. ' 
There is nothing to warrant the assumption that the freshmen as 
a group were more skillful at this sort of thing by reason of 
previous training. The differential of motivation and mental at- 
titudes is the explanation of the differences of an average of 21 

'These iIbC* gtvi- 
■re using tbem only l< 
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columns per five-minute period for the freshmen as against an 
average of (Ij for the juniors,' 

The percentage correct for the juniors is in general the same as 
for the freshmen. It will be observed, however, that the decrease 
in amount correct is approximately the sam'^ fbr the ^niors as 
for the freshmen. There is no reason to believe that this decrease 
is due to fatigue; the test was given at 8:00 a. m., the first hoar 
of the academic day. 

TABLE III 
Data obtained from 54 college juniors 
columns added: 



in terms of number of 



1st 6 I 

2d 5 ] 

3rd 5 1 

4th 5 I 

6th 5 1 

6th 5 I 

7th 5 1 
Av. 





J 


.1 


k 


pill 


'III 


il 




II 














u 


£5 


lU 5£ 


^sU 


^K 


in 


998 


872 


87 


18 iu'4.18 


16 


4.67 


un 


843 


720 


84 


16 '>'.(.4.90 


13 


6^ 


lin 


902 


755 


85 


17 k, J 5.46 


14 


6.14 


in 


868 


725 


82 


16,fc., 4.92 


13 


6.06 


in 


836 


690 


83 


I6.i-X4.96 


18 


6^0 


va 


867 


710 


88 


16 ,i:4 4.71 


18 


4.9S 


lin 


876 


726 


81 


16,fc.;5.09 


13 


6.6S 




6178 


5198 


83.125 


16.3 


13.6 





CONCLUSION 

The above data support the following assertion: The difference 
between a genuine motivation such as the freshmen had, and the 
kind of motivation a college class contains, is a -difference which 
not only offsets extreme fatigue, but further offsets freshman v». 
Junior ability, and in addition produces twice as much work per 
unit of time with equal accuracy. 
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INFLUENCE OF MENTAL LEVEL IN THE 
FORMATION OF BOYS' GANGS' 



By M. LaVinia Warner, 
Ohio University 



It has bsen noticed that certain boya group together; that a 
boy will have certain friends and not seem to have any other very 
close friends. There may be several circles of friends among the 
boys in a community and the circles will not intersect. 

This seems to indicate that there ia a fundamental cause why 
certain groups of boys are found together and that it is not chance 
but some underlying law that groups boys. The boys are brought 
together by churches, schools, and the like, but the churches and 
the schools do not classify them into the different groups and gangs. 
Hence the question arises: Why are certain boys found in one 
gang and not found in some other gang? 

Dr. Charles B. Davenport in speaking of the mating of the 
feeble-minded says, "The meager social life, the customs of their 
parenta, the natural ostracisms of the higher classes, and the in- 
dividual's preference for a congenial mate induces in marriage 
among the mentally deficient." (2)* He found that the more fre- 
quent results of immigration of a feebleminded is his marriage 
into another defective strain in another part of the country. Altho 
in different localities, their social standards have been practically 
the same, for social standards are determined by mentalities as 
weU as by experience, education and wealth. Consequently tliiir 
social standards have been influenced mostly by mental level and 
inmarriages of the defective strains have resulted. "The social 
laws and natural preference of the individual is so powerful that 
like will consort with like even in outmarriage." (2) 

Dr. Davenport says, "The law that like tends to marry like in- 
terferes with the beneficient tendency (that the introduction of 
now blood would lead to better progeny) of outmating. The eon- 
sorts selected from outside are frequently quite as defective as 
those iriio select them." (3) 

Miss llina A. Sessions gives the same ideas of marriage selec- 
tion as those given by Dr. Davenport. Miss Sessions says, "The 
reason for so many cousin marriages are probably twofold. First 
in their own stock they find the most congenial companions, and 
second, they are largely forced to marry each- other for the simple 
reason that no one else will marry them or have anything to do 
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with them. When the^ do marry outside the family, they many 
some member of a weak strain." (10) These investigations lead 
us to believe that "Birds of a feather flock together," even in mar- 
riages of the feeble-minded. 

The same idea holds true in marriages of the deaf. Dr. Fay 
says, "In no human relation is the truth of the proverbs, 'Birds of 
a feather flock together' and 'A fellow-feeling makes one wonder- 
ous wise!' more fully exemplified than in the friendships and mar- 
riages of the deaf." 

In his study of the divorces of the deaf, Dr. Fay found the pro- 
portion where both partners were deaf to be 2.5 per cent and where 
one was deaf the other hearing, the proportion reported is 6.4 per 
cent. This shows that the matings were more successful where 
both partners were deaf than in cases where one was a hearing 
person. The deaf partners were more congenial than one of them 
could have been if he were connected by hearing and speaking with 
those around him. (5) 

The deaf have a common mode of expression. This enables 
them to appreciate and enjoy one another. Each is more or less 
barred from the hearing folk and he is glad to have a companion 
similar to himself. Their deafness causes them to hav« common 
experiences. It is the effect of their deafness that attracts and 
holds them in companionship. 

Dr. Davenport and Miss Sessions determined for th« feeble- 
minded and Dr. Fay determined for the deaf, that there are com- 
mon factors at work in bringing and holding together each of 
these respective types of people. This snggests that the same 
principle could be applied to other types. 

In order to make a study of the factors determining hoys' gangs, 
various groups of boys who have been brought into court and who 
were known to be close companions by court officials, sodal woA- 
ers and school officers, have been investigated. The data was de- 
rived from school reports, court records, and the records filed by 
the Children's Service Bureau, Youngstown, Ohio. The aodal Ua- 
tories are the reports of investigations made by the bureau's special 
social workers. The pyscbological examinations were made by Dr. 
H. H. Young, director of the Children's Service Bureau and his 
assistants in psychology. 

Thirteen groups and seven pairs of boys were tabulated and 
sixty-six different individuals were included in the study. 

The ages in each group were computed to the date of crime com- 
mitted by that group, or if no particular date could be obtained, a 
given date was taken. So in each group both the chronolocieal 
and the mental ages of each child are given for the same date as 
that of his companion. 
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REPRESENTATIVE CLUBS AND GROUPS 

THE FRANKLIN CLUB 

A group of boys traveling about the city doing many little things 
that were not to be favored, attracted the attention of court of- 
ficers and social workers. These boys were well equipped for vari- 
ous sorts of business that require no arrangements with the other 
party concerned. 

The gang had three horses and an old wagon. They drove 
about the city picking up bottles, rubber and the like and "stealing 
oranges, bananas, whips, pop, beer, whiskey, cigarettes, copper," 
etc. 

When about nine years old, A. S. one member of the gang, told 
of cutting the windows at a gun shop and how they were chased 
by a policeman. He said that they were caught twice and that 
when caught they gave wrong names. He said that they generally 
drove the best horse so that they could make a better get-away. 
They got up at two or three o'clock in the morning and "went out 
picking," returning about five o'clock. 

A. S. gave many instances which show that they are a real gang. 
Their environment leads them to do anti-social things and with 
their low mentalities, they do not always make a successful get- 
away. In all probability they are caught many more times than 
they would be if they were of higher mentalities. 

Their main work aeema to have been stealing automobile parts 
from one party and selling them to another. In one case they 
would take the materials back and sell them to the "Jew" from 
whom they had stolen them. 

The gang was first noticed in particular when they broke into 
a jewelry store window in order to steal some nickels that were on 
display in the window. The boys got the idea of cutting the glass 
from a picture show. The actor cut the glass with a glass cutter, 
then tapped it lightly until a smooth piece fell out. The boys had 
gotten some glass cutters from a twenty-five cent store the day be- 
fore. They had stolen some of the cutters and had bought some. 
They were not as successful as the actor on the screen, however, 
in cutting the glass. A policeman came along, arrested them and 
took them to the Detention Home. They were given a hearing in 
the Juvenile Court and the judge suspended sentence in each case. 

A few days later a boys' worker formed this group of boys into 
a club, later called the Franklin Club. The boys' worker tried to 
interest tbem in athletics and games of various kinds. They were 
taken to the park on hikes and in every case their individual inter- 
ests were studied and appealed to as far as possible. 

For a period of a few weeks after these boys had been organized 
into the club, they seemed to be doing well, but they were soon 
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back to some of their former habits. About a month after their 
organization, some of them played truant and some one stole from a 
store in the community. Comparing their record of the past year 
with their behavior at this time, little improvement was found. 
After working with these boys and not getting the results which 
the boys' worker hoped to get, he took them to the Children's 
Service Bureau for mental examinations. 

The following table shows the age, mental age and I. Q. of each 
at the time of breaking the jewelry store window: 
TABLE I 

THE FRANKLIN CLUB 

Chronological Age Mental Age 

Name Years Months Years Months I. Q. 

J. C. 10 7 10 78 



F. P. 11 5 7 11 69 

A. S. 11 7 2 S5 

S. V. 13 1 9 1 69 

Table II gives the mean variation of the chronological ages to 

be eleven months and that of the mental ages to be only five 

months. 

TABLE II 

AVERAGE AND MEAN VARIATION 

Chronological Age Mental Age 

Years Months Years Months I. Q. 
Average 11 9 7 11 68 

Mean Variation 11 6 4.16 

Table I shows that the boy with the highest I. Q. is the yonngvst 
chronologically and that the boy with the lowest I. Q. is the oldest 
chronologically. The case of S. V. who ranks a year and more 
above the others in mental age, is explained in his record which 
shows that he is slow and easily led by others. Dr. Young states 
that S. V. is incapable of making his own decision. He is. highly 
suggestible and is largely dependent upon his immediate environ- 
ment and associates. His easy way and tack of will power is 
probably the cause of his being led by lower mentalities. Taking 
the group as a whole, the tables show that the mental ages bear 
a close sameness. 

There are other gangs of boys in the neighborhood, but the 
Franklin boys are not found with them. The Franklin boys at- 
tend regular public schools, and this chance to meet other com- 
panions does not seem to affect their choice. Altho they come 
in contact with the higher boys, the duration of their companibn- 
ahip is BO short and non-social that no noticeable event takes place. 
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No doubt, the mentally higher boys commit little crimes, bat they 
bar from their company any one who is liable to expose them. 
Consequently the type of mind found in the Franklin club has no 
place with the higher type child. Then the lower level boy would 
not be able to contribute to the success of the gang and being a 
misfit he would go where he could he nearer the top in action and 
where he would be on an equal with his fellows. 

The public school attendance department shows that in cases 
of truancy among the Franklin club, the boys were either alone 
or in company with another member of the club. However, the 
record of J. F. shows that he played truant three times with Jiwo 
other boys but their mental ages do not differ from J. F.'s more 
than six months and the I. Q.'s are within the range of seven units. 

Court records show that boys from this club have committed 
ten different crimes in company with one another, but there is no 
account of any one of them being arrested in company with a boy 
who rates with normal mentality. Three boys from the Franklin 
club, however, have been in court with boys from other groups 
which are included as subjects for this theme and in each case the 
other boys rate below an I. Q. of 69 and with a mental age not dif- 
fering a year and seven monHis from that of the Franklin boys, 
and within six months on the average, 

GROUPS NUMBERED SEVEN, ELEVEN AND THIRTEEN 

Of the boys examined in group seven, the one with the highest 
I. Q. is the youngest chronologically, and has the highest mental 
age. Altho the difference in mental age is greater than that in the 
Franklin dab, yet the same tendency that like mental ages tend 
to group together is found here. 

TABLE III 

GROUP SEVEN 

Chronological Age Mental Age 

Name Years Months Years Months I. Q. 

C. B. 16 10 8 71 

J. B. 16 8 8 6 64 

J. A. 16 ' S No mental rating 

J. B. A. 13 3 No mental rating 

R. C. 15 6 9 4 60 

C> B. and J. B. are very dose friends, C. B. being the follower 
and admirer of J. B. J. B. is so low mentally that he will jump 
into any undertaking without fear of consequences and C. B. is 
tow enough to follow the example. C. B. is not troublesomely in- 
clined and he would probably cause society less trouble if it were 
not for his close companionship with J. B. Although C. B. is not 
80 low mentally as J. B. yet because J. B. is older and larger and 
la able to do striking things, C. B. easily falls in line with all his 
mlademeanors. 
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Dr. Youns says, "Time and again through the interview con- 
cerning C. B.-s past history, he referred to how much he thinks 
about J. B. taking money. He seems to be much impressed aiid to 
think much about how J. 6. takes money from his father. The 
repeated reference to this together with the outline of what and 
how C. B. himself has stolen and what induced him to steal, seems 
to indicate that he has a dominating mental complex about J. B. 
and his stealing which with his low mentality is very largely, if 
not entirely the cause of hig own stealing." 

The individual records of C. B. and J. B. are very similar. Their 
histories of theft and night wanderings are practically the same. 
It is not exactly an influence which J. B. has over C. B., but it ia 
a kind of unconsciousness on J. B.'s part and a thoughtless fol- 
lowing on the part of C. B. 

J. A. and R. C. have also led C. B. to steal. J. A. was not given 
a mental examination, but his school record shows him to be re- 
tarded more than three years and he has a long court record antl 
a boys' industrial school record. His father reports that he can- 
not control him. 

J. B. A. had no mental rating either, but his school record shows 
poor attendance and the principal reports that J. B. A. is in one 
day and out for weeks, and that all his school work is a complete 
failure. He is pushed on in the grades and does not flt anj'where. 
He is three years retarded in all his subjects. 

The histories of J. A. and J. B. A. and the mental ratings of 
the other boys show the group to be below normal and their mental- 
ities to be somewhat equal. As in the Franklin club we have no 
account of these boys chumming with mentally higher boys or 
boys of the normal type. 

J. B; and C. B. appear in Group Thirteen with A. S. a member of 
the Franklin club and with two other boys whose mentalities are 
undetermined, but whose social standards are rated by social 
workers with those of their companions. Taking these boys as a 
group, we have a difference in mental ages of two years and six 
months and a difference in chronological ages of three years and 
five months. All are so mentally equipped that they are able to 
enjoy the same things. Each is in a group where like types are 
found. The 1. Q.'s of these boys are helow 71 and the I. Q.'s of 
their friends are below 7S. 

In the study of Group Eleven, it was found that the chronolog- 
ical ages are in an inverse ratio to the mental ages. 
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A. K. 



GROUP ELEVEN 

Choronological Age Mental Age 

Years Months Years Months 



15 



10 



I.Q. 

59 



S. J. 

G. B. 12 7 10 8 86 

The experience griven the older children by living longer in the 
world tends to place them on an equal basis with the younger 
children who have higher mental ages. Consequently the experi- 
ence on the one side and the experience and the higher mental 
ability on the other enable the boys to enjoy one another's com- 
pany. The inverse ratio is found in Table I also, but it is not 
emphasized there so much. In fact, this tendency is found in all 
the groups. 

Table V shows that with the exception of three groups and 
one pair, the I. Q. of the youngest boy is greater than the I. Q. of 
the oldest boy. 

TABLE V 

GROUPa OP MORE THAN THREE BOYS 



CROUPS OF THREE 



Average difference 16 
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This shows that older boys with mentalities below normal have 
a tendency to group with yotinger boys who have a mental age 
near their own and slightly higher. The higher mentalities of 
the younger boys enable them to cope with the older boys who have 
the experience of living longer in the world. This illustrates how 
mental equality exists in groups formed by natural selection and 
indicates that mental abilities tend to go together. 



GROUP CONTAINING BOVS OF NORMAL MENTAL ABILmr 

In three groups and in two pairs boys were found who rank 
with much higher intelligence than the other members of the 
groups. These conditions were explained when it was found that 
in each case, excepting one, the boy with the I. Q. much higher 
than the others was psychopathic, and he also had bad heredity 
which would influence his choice of society or would lower hia 
standards of society. 

In one pair, the lower type boy was twelve years and one month 
' old and mentally eight years and six months with an I. Q. of 70 
and the other was twelve years and eight months old and 
mentally thirteen years and four months with an I. Q. of 106. 
The mentally higher boy is an adopted child. Nothing is known 
of his father. The whereabouts of his mother is unknown. His 
mother left him at a Salvation Army Rescue Home when he was 
two years old and never returned for him. The mother is reported 
to be a drinking and immoral woman. The foster mother saya 
that the boy is very bossy and always wants others to do as he 
wishes. His psychological record shows that "he does not have 
the persistance to work out a task requiring careful decision and 
forethought. He is psychopathic and impulsive to the extent that 
thru the path of least resistance he fails to use the intelligence 
which he has." The principal of the school where he attended 
reports that his work was extremely poor, his behavior was very 
queer and that he had "a mean disposition." His foster parents 
appealed to the court for a disciplinary school for the boy. They 
felt that he needed stricter discipline than they wanted to give 
him. 

The family of the mentally lower boy moved into the same house 
with these foster parents. The boys vrere not acquainted before 
this. The younger boy is one of those nice looking, talkative chaps 
who is in for everything and who will undertake anything. The 
father does not live at home and the mother is unable to control 
the child. The older boy not caring to "use the intelligence which 
he has" would be glad to have anyone for a companion who would 
follow his suggestions and who would not be hampered by fear to 
do anything which might come up before the lads. The boys played 
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tmant together several times and once they ran off to aoother 
city together. 

In another case the hoy who was rated as average mental ability 
was considered by his mental examiners as one who would be 
readily inflaenced by bis associates; that he would probably not 
initiate -much, but might readily become a follower. He is psycho- 
pathic. 

Another boy is much younger than the other boys in his group, 
but his mental age is about the same. He is lacking in initiative 
and is somewhat psychopathic in his responses. He is easily in- 
fluenced and too readily submits to the wishes of others. 

The boy who is not psychopathic is considered a case of adoles- 
' cent instability. Possibly later be will grow more stable and will 
seek other boys for companions. 

It would be interesting to continue the study of these boys to 
see if they still chum with the mentally tower boys in a few years 
following, but it is impossible to do that in this research. 

INFLUENCE OF NATIONALITY AND PROXIMITY 

A study was made of the nationalities represented in the differ- 
ent groups. Youngstown's greater population, about eighty per 
cent is foreign. In most of the groups there would be as many 
nationalities represented as there were cases. It was found that 
the nationality did not enter in. If the boys were all Italians, it was 
because they lived and met in the same Italian district. 

Proximity and school effected the meeting of most of the groups 
and pairs of boys. In a few instances the boys met in the down 
town section where they sold papers or where they loitered around 
the cheap theatres. In one case the two boys lived on opposite 
sides of the city. They met down town several times, became very 
good friends and finally decided to steal enough money from their 
fathers to run away. In nine groups the boys of each group at- 
tended the same school, in ten groups the boys attended adjoining 
schools, and in one group three of the boys attended different 
schools found in the same quarter of the city and the other two 
boys in the group were the ones who lived on opposite side of the 
city. 

This division of these particular groups would not hold true so 
very long, however, because the school system often transfers the 
pupils from one school to another and sometimes a child is placed 
In a Parochial school for a term or two. In many cases the 
children living on the dividing line of two school districts may 
have a better chance of getting acquainted than children attending 
the Bame school. The after school hours are not so closely super- 
vised as the school hours and the children may have more freedom 
in choosing their playmates. Even on the playground at school the 
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children are more or less held from freedom of choice by their 
school officers. Going to and coming from school and the free 
hours afterwards give the best opportunity lor natural selection 
of companions. During these free hoars the boys may wander 
where they like and they may play with whom they choose. If 
they do not like one group of boys, they may play alone or go 
off with one or two others who enjoy the same things which they 

VARIATIONS OF BOTH THE CHRONOLOGICAL AN THE 
MENTAL AGES 
In Table VI we find that the mean variatio nof the mental a^ 
is less than the mean variation of the chronological age in three 
out of five of the largest groups, that is the groups containing 
more than three boys. This shows that there is a tendency for 
less variation among the mental ages than among the chronological 
ages. 

TABLE VI 

MEAN VARIATION AND RATIO OF MEAN 
VARIATION TO AVERAGE 

Mean Variation M. V. Average 

Chronological Mental Chronological Mental 

Group Age Age Age Age 

1 13 months 7 months 



Franklin 



10 



15 



17 



.14 



Since the intelligence quotients are below 100, the mental ages 
are less than the chronological ages and are expected to be nearer 
together. In order to determine further that mental age has more 
weight than chronological age in the formation of groups of boys, 
the ratio of the mean variation to the average (coefficient of varia- 
tion) in both the chronological and the mental ages was com- 
puted in the larger groups and a comparison was made of their 
variability. It was found that the mental ages were less variable 
than the chronological ages in all the groups excepting in Group 
Two and Group Ten. See Table VI. In these two groups the 
chronological ages were slightly less variable than the mental ages. 

Xhe average of the mean variation of all the groups and pairs 
was found to be 10 months for the chronological ages and 11 
months for the mental ages. This includes the groups whose mean 
variation was higher for the mental age than for the chronological 
age and the pairs whose mean variations were not thought neces- 
sary to compute before because of the small number of hoya in- 
cluded in each. The mean variation for the whole population (66) 
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was foand to be 18 months for the chronolo^ica] age and 16 months 
for the mental age. Thus we find: 

Chronological Age: Mental Age 

Average M. V. of Group 10 .05 11 

M, V. of population 18 16 

In some groups, the chronological ages are quite similar. This 
is very marked in Group Two. In this group, all of the chronolog- 
ical ages are in the twelfth year. The mean variation of the 
mental ages is greater than the chronological ages of Groups 
Four, Seven, Ten and Twelve. 

In Group Seven, the chronological ages are very similar and the 
mean variation of the mental ages is greater as near as could be 
discovered. Two members of this group have no mental rating so 
the mean variation of the mental ages could not be determined in 
exact terms for all the members in the group. 

The chronological ages of the two boys in Group Eight are 
nearer together than their mental ages. The chronological ages of 
the other boys in this group could not be found and they were 
not given a mental test, so they might alter this group in either 
direction. There is very little difference in the chronological ages 
in the boys of Pair Fourteen and in Pair Nineteen, also. 

This shows that chronological ages might have some weight in 
the grouping of boys, but since there are more groups in which 
the mean variation of the mental ages is less than the mean varia- 
tion of the chronological ages, we might conclude that there is a 
tendency for the mental ages to have more weight in the formation 
of boy's groups than chronological age. 
DISCUSSION 

In the Franklin Club the mean variation of the chronological 
ages is twice as great as that of the mental ages. In this group, 
mental age must have afTected the grouping. Common experience . 
enters into the grouping also. If one of the boys had lived until 
this time in a rural district he would not have enough experiences 
common to the others to fully appreciate the attitudes of the other 
boya altho their mental abilities are practically the same as his. 

Proximity influenced the grouping in most of the cases. It even 
had an influence in the case of the boys living on opposite sides of 
the city. It was a common experience which brought them together 
and It was their mental ages kept them together. If one of the 
boys had been mentally high and the other mentally low, their 
common experience of selling papers down town would scarcely 
have been noted. Common experience is the means of bringing the 
boya together and mental level is the determining factor which 
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continues U> make their experiences 

Experience, education, and social status help determine the 
choice of comrades among adults of the same level and their social 
standards may differ so that their tendencies might be in an 
almost opposite direction, but among children the selections are 
less controlled. Children have more freedom in choosing their 
companions because they have not lived long enough to be in- 
fluenced in making their choice. Social standards, experience and 
education have not affected them to so great an extent. 

The boys in these twenty groups were not known to associate 
with boys who rank as normal, altho they had the same opportun- 
ity to get the same experience. Physically, their experiences were 
common, or could have been, but mentally each type of mind in- 
terpreted the experience to suit its own level. 

In several groups, the oldest boy has the lowest I. Q. and the 
youngest boy has the highest I. Q.; that is, the I. Q. varies in- 
versely with the chronological age. This brings the mental ages 
to an equalized level. 

Boys of the same mental level can understand and appreciate 
the same things. They have reached the same degree of progress 
in the stage of mental development. Their minds are so equipped 
that they can appreciate the same situations. Consequently, each 
is at home with the other. No one is comfortable for a very long 
time if he is much inferior to those about him. He must have a 
feeling of his own importance; that he has a place of his own 
in their society, or he will begin to shrink mentally away from 
them. On the other hand, if he can play his part on an equal 
basis with his companions, he will have a feeling of satisfaction 
and win be content to remain in their company. 

A boy mentally high will not be satisfied with companions sev- 
eral degrees below himself. They cannot reach his ideas and he 
will grow tired of being tied down to their level, so he will stand 
aloof or seek others for companionships, except in some cases 
where he takes a paternalistic attitude, and assumes a sort of 
guardianship or big brother attitude. 

A special class teacher reported that her two lowest children 
who were about seven years of age, would not have anything to 
do with one another. No doubt they were too young mentally 
to be social. They were mentally below four years. The older 
and higher type of children in the class enjoyed leading these 
younger boys about and caring for them. They had the paternal- 
istic attitude and the younger children enjoyed the feeling of their 
protection. We enjoy being with leaders or individuals who are 
our superiors because we feel that we are being benefited by their 
presence. They cause us to live in an ideal state which we enjoy. 
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The low type child enjoys the company of the older children be- 
cause he likes to have them do things for him. He is taking a 
babyish attitude . 

'This is not an attempt to solve the problem of group compan- 
ionship in so brief a study of so few cases, but the investigation 
indicates that mental age is the greatest factor in the selection of 
one's companions and in holding groups together. It indicates 
that a common mental level with similar experiences as a back- 
ground is B much stronger factor in group formation than any 
other factors investigated. 
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LEGIBILITY OF BODONI. BASKERVILLE ROMAN, 
AND CHELTENHAM TYPE FACES 



By Harold E. Burtt and Coryne Basch 
Ohio State University 



INTRODUCTION 

The importance of type legibility for advertising or general 
reading needs no comment. The outstanding variables condition- 
ing legibility are size, case and face. The present stndy is con- 
cerned primarily with the last of these and is confined to an 
intensive investigation of three common type faces. 

There are five methods (as far as the writers are aware), for 
measuring legibility : maximum distance at which type can be 
read, time taken to read a passage, number of letters read in a 
tachistoscope or minimum exposure at which they can be read, 
minimum illumination under which type can be seen and extent 
to which letters can be thrown out of focus and still be identified. 
The first two of these methods have been the ones most frequently 
used. The present study used the last of the five methods men- 
tioned. 

The most extensive study of type faces is that of Roethtein.' 

She presented o page of 28 letters at a distance beyond the 
limits of legibility and then advanced it towfird the observer by 
20 cm. increments, recording at each stage the letters that could 
be idcntilied. This method made it possible to accumulate a large 
amount of data in a reasonable time and a considerable number 
ot different faces were studied. Cheltenham, however, was the 
only one which she used that was involved in the present study 
so no comparison is possible. 

Roethlein found that legibility depended on form, size and 
heaviness of the letters and on the margin, position in group 
and on the shape and size of adjacent letters. 

Scott' found that a longer time was taken to read a light-faced 
type than to read a heavy-faced type. 

Adams' performed an experiment on speed of reading a aeries 
of advertisements set in a wide variety ot type arrangements. 
The material was too complicated to throw much light on the 
specific problem of type face. 

The present study tried to abstract from all variables except 
type face. Individual letters were used, all of the same size. 

■liocUilftu. 11. W. Thr llclatirc Lefflhilily 'if Iilffffcnt facet of Printing 
Ti-i.i». Amir, .1. ii( l'»y<li. Ull'.', »!. J-3U. 
H:f. HolllnEwnrlli, H. L. AilFnliilaff OHrf Hrlllau- UK*. P- 73. 
'AUhiiih, II. F. AdccrlialHg ami ilt JlenfnF Lairi, 1U:J1, p. 214. 
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MATERIAL 

Three type faces were used in the experiment — Bodoni, Basker- 
ville Roman, and Cheltenham Medium. These were used in both 
upper and lower cases. All the letters were fourteen point so 
that the size variable was constant except in so far as the upper 
case letters often occupied greater area than the corresponding 
lower case of the same point. The letters were cut from sample 
booklets of the American Type Founders Company. 

Each letter was centered individually on white unglazed card' 
board 6x6 inches for exposure. It was impossible to get a com- 
plete alphabet in all the faces and cases. Consequently, the re- 
sults considered below were based on all the letters of the alphabet 
with the exception of J, K, L, Q. U, X, Y. Z, Several of these 
letters are rather infrequently used anyway. The remaining 
eighteen letters in the three faces and two cases make one hun- 
dred and eight letters involved in the investigation. Some other 
letters were included but the results not considered. 

The material was presented in a Focal Variator.' This ap- 
paratus comprises an exposure tield about 6 inches square illumi- 
nated by daylight lamps inside a hood. The material exposed is 
projected through a stationary convex lens which controls its size 
and then through two similar lenses which are arranged to move 
reciprocally so that the focal point of the image may be changed 
without altering the size. The material is projected through this 
differential system upon a stationary ground glass so that as the 
lenses move the image on the glass goes in and out of focus. The 
subject sitting with his forehead in a head-rest fifteen inches from 
the ground glass observes the images. In the present experiment 
a quarter-inch diaphragm was placed on the lens next the ground 
glass to lessen the marginal glare. This was desirable because of 
the small size of the letters used but did not affect the focus. 

The differential lens system was controlled by turning a small 
crank. This crank actuated a screw IG threads to the inch so that 
for each revolution an indicator moved l-16th of an inch on a 
linear scale. The crank was also attached to a small wheel with 
its margin graduated into lOOths so that it was possible to make 
readings to 1-100 of 1-16 of an inch. 

The data will be presented in terms of these scale readings. 
However, it is possible to convert such readings into terms of the 
position at which the image is actually in focus. 

The apparatus was set during the experiment so that at zero 
scale reading the image was perfectly in focus on the ground glass. 
The callibration curve was obtained by movin gthe ground glass 
toward the lenses by increments of one inch and at each point 

'WelHH. A p. Thf foral XhiOiIoi: .Iniirnnl of KxpiTliiifnlnl I'Kjchulogy. 
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determining the scale reading when the image was in perfect focus. 
These determinations were made by coming in both directions from 
illegibility until a letter showed no appreciable increase in clear- 
ness and continuing until it began to decrease in clearness. These 
four scale readings were averaged. This procedure was followed 
with five typical letters at each point and with two observers. 
Scale readings were plotted against distance of the focal point 
from the exposure field. The curve ia practically a straight line 
whose equation by least squares is 2.09x-.64y+26.S5=4) x repre- 
sents scale reading, and y represents distance of focal point from 
the exposure field. 

METHOD 

The experiment was conducted in a dark room. During an actual 
trial there was no illumination except the lights in the hood and 
a small heavily shaded light near the scale. Between trials there 
was practically no change in the illumination so that the subject 
was substantially adapted throughout to the g:round glass field. 

Prior to each trial the lenses were turned to a point previously 
determined where all the letters were invisible. A letter was then 
placed on the field at the back of the hood. At the signal "ready," 
the observer placed his forehead on the head rest and fixated the 
center of the ground glass. The experimenter then turned the 
crank at the rate of one revolution in four seconds, keeping time 
with a metronome. The observer named the letter as soon as he 
recognized it. If his response was correct the experimenter re- 
leased the handle immediately and recorded the reading, If the 
response was incorrect, the experimenter said "No" and continued 
turning the crank until the correct response was given. The in- 
correct response was, of course, subsequently recorded. 

The letters were given in a random order with all the cases and 
faces inter-mixed. Each subject worked for two sittings and in 
some cases three, in order to complete the entire series. The 
subjects were frequently asked if they were fatigued and there was 
considerable opportunity for rest between trials while the ex- 
perimenter was recording results and changing material. 

The subjects were seven students taking a laboratory course in 
psychology. None of them had had experimental training other 
than that which they had received in the course. There were five 
males and two females. Five of the seven had previously per- 
formed a simple experiment with a Focal Variator themselves. 
The vision of all was 20-20 or corrected to that by glasses. 
RESULTS 

The outstanding differences between the three families of letters 
are shown in Table I. The first column gives the observer, the 
second the average reading of that observer for the eighteen letters 
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in Bodoni upper case. The next column, the readings for Bodoni 

lower case, and so on. For example observer number one gave an 

average scale reading: for the eighteen letters in upper case Bodoni 

TABLE I 

AVERAGE LEGIBILITY OF 18 LETTERS 

Observer 



Bodoni 


BaskerviUe 


Cheltenham 


V.C. 


L.C. 


U. C. 


L. C. 


U.C. 


L.C 


14.7 


11.4 


14.6 


12.8 


17.6 


13.1 


12.9 


10.9 


13.6 


12.0 


16.4 


12.9 


12.9 


10.9 


16.5 


10.9 


17.9 


13.4 


12.2 


10.7 


13.1 


10.7 


14.4 


12.0 


13.6 


11.2 


15.B 


12.6 


17.4 


13.2 


12.7 


11.8 


15.5 


12.4 


17.5 


13.6 


13.9 


11.0 


15.8 


11.9 


17.5 


13.3 


13.3 


11.1 


14.9 


11.9 


17.0 


13.1 



Average 

of' 14.7 16ths of an inch. His corresponding reading for Bodoni 
lover case was 11.4. For BaskerviUe upper case 14.6 and so on. 
The bottom row in the table gives the average for the seven ob- 
servers. The same results are shown graphically in Figure 1. 

The abscissa of the curve represents the three faces indicated 
while the ordinate represents the scale readings. Each observer is 
indicated by a different type of curve with the heavy curve giving 
the averages. The nine curves nearest the bottom of the chart 
indicate lower case and the others upper case. 

The general tendency of results is obvious, Cheltenham is more 
legible than BaskerviUe. BaskerviUe in turn is more legible than 
Bodoni. The results are more marked with the upper case letters. 
It may be noted incidentally that throughout the upper case is 
more legible than the corresponding lower case. It should be 
borne in mind, however, that we are here dealing with individual 
letters whereas it is wejl known that entire words printed in lower 
case are more legible than the same words printed in upper case. 

The results arc presented from the standpoint of probable error 
in Table II. 
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Bodoni Bodoni Baskerville 

Baakerville Cheltenham Cheltenham 

U.C L. C U. C. L. C. U.C. L. C 



Vri 4.8 1.9 8.3 5.8 4.3 2.8 

Average 3.2 1.5 6.9 3.8 3.7 2.2 

All cases 7.2 3.0 16.9 9.5 8,8 4.4 

This table gives the ratio of difference to probable error of dif- 
ference for the various comparisons and subjects indicated. For 
example, with subject I the difference between the average of 
Bodoni upper case and the average of Baskerville upper case is 
0.2 the probable error of difference, while for those two faces in 
lower case the difference is 2,2 the probable error. The figures 
for the seven subjects in each column are averaged in the row 
marked "average." The probable errors were also computed for 
all the letters of a given face and case for all the observers, i. e., 
126 (18x7) readings. The differences between the averages at 
the bottom of Table I may be thus evaluated and in Table II the 
row "all cases," gives the ratios of these differences to the prob- 
able errors of difference. 

The table indicates that the difference between Bodoni and 
Cheltenham upper case is un<iuestionably significant, as the 
smallest individual subject's difference is 4,8 P. E. The differ- 
ences between Baskerville and Cheltenham 'are not as marked but 
some of the individual differences are significant and the average 
difference undoubtedly so. The differences between Bodoni and 
Baskerville upper case are of about the same order although not 
quite as large. With the lower case letters the relations are much 
the same as with the upper case but all the differences are some- 
what smaller from the standpoint of probable error. The differ- 
ence between Bodoni and Cheltenham is the most marked, that 
between Baskerville and Cheltenham somewhat less, while ^at 
between Bodoni and Baskerville lower case is of somewhat doubt- 
ful signilicance. 

These results seem plausible from analysis of the characteristics 
of the three families. Cheltenham involves relatively heavy strokes 
of fairly uniform width, Bodoni on the other hand, involves many 
light strokes and this is especially marked with upper case letters. 
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Baskerville likewise involves light strokes though not as light as~ 
Bodoni. This corresponds to its intermediate position in legibility. 
In addition to the differences between the families established on 
the basis of the average of 18 letters, there may be points of inter- 
est in considering individual letters in the various faces. Table III 
presents data from this standpoint. Each entry in the table rep- 
resents the average of the seven subjects for the letter and face 
indicated. 

TABLE in. 







Basker- 


Basker- 


Chelt- 


Chelt- 


odoni 


Bodoni 


ville 


ville 


enham 


enham 


U.C. 


L.C. 


U.C. 


L.C. 


U.C. 


L.C. 


13.1 


9.6 


13.9 


9.9 


16.9 


12.4 


12.7 


13.0 


14.1 


16.2 


16.1 


14.fi 


14.1 


10.7 


16.8 


11.4 


18.3 


13.2 


14.0 


12.2 


16.3 


12.6 


18.2 


14.6 


12.7 


9.4 


13.1 


10.6 


16.2 


12.2 


11.2 


11.6 


14.2 


12.1 


15.4 


10.6 


13.7 


10.9 


16.6 


9.9 


18.2 


10.1 


14.2 


12.6 


15.6 


13.3 


17.1 


14.7 


12.8 


10.0 


12.2 


13.5 


13.1 


13.6 


13.7 


13.7 


16.9 


11.9 


17.2 


16.8 


11.8 


9.7 


16.9 


11.0 


17.0 


11.9 


16.8 


12.5 


17.0 


12.7 


20.2 


14.5 


14.4 


13.6 


14.8 


14.1 


17.8 


16.4 


13.0 


11.1 


14.1 


11.5 


16.6 


10.6 


13.5 


8.6 


12.9 


10.3 


15.3 


11.6 


11.7 


9.1 


14.1 


9.5 


16.6 


11.0 


12.2 


10.9 


14.0 


11.9 • 


18.1 


13.2 


13.3 


11.4 


17.1 


13.4 


17.9 


14.8 


13.2 


n.i 


U.9 


11.9 


16.9 


13.0 


y the 1 


egibility . 


differences ' 


vary with 


the letters. The 



safest way to consider the matter is in terms of probable error. 
This was computed for any differences between means of the same 
letter in different faces that seemed of possible significance. 

The differences between lower case Bodoni and Cheltenham are 
most pronounced with the following letters and the differences are 
all greater than 4.5 the probable error: S, I, V, C, A, E, W. 
Most of these letters involve a considerable portion of light strokes 
which in the Bodoni are of course very light. With lower case 
Baskerville and Cheltenham the ratio is 7.2 for A and 4.4 for C, 
with all the others leas than this. With Bodoni and Baskerville 
lower case the ratio for I is 8.9 but the next smaller is 3.7 for P. 
The most noticeable fact regarding the lower case letters is per- 
haps the inferiority of Bodoni or Baskerville A to Cheltenham A. 
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This letter has three light horizontal strokes. 

With the upper case the differences are relatively ^eater. For 
Bodoni vs. Cheltenham they are significant for practically all 
letters, but most tnarked in the case of V, N, B and 0. With 
Baskervillc and Cheltenham, V, E, P, S and R, all have differences 
frreater than 4.5 P. E. With Bodoni and Baskervillc the ratio for 
N, G and B are greater than 4.5. One noticeable thing is the 
poor showing of Bodoni N. It comprises two very light vertical 
strokes. 

Another method of approach is to consider each letter's legi- 
bility relative to the others of the same face and case. This 
could be accomplished by ranking the values in each column of 
Table III. The greatest discrepancies between an upper case 
letter's rank in different faces are as follows'. N has relatively 
low legibility in Bodoni compared with Baskerville. This fact 
has been noted above ; S however ranks much higher in Bodoni 
than in Baskerville. V stands high in Cheltenham but low in the 
other two. With lower case letters the following discrepancies are 
large. Baskerville I is relatively high in legibility and Bodoni I 
relatively low. Bodoni F is relatively high and Cheltenham F, 
relatively low. Cheltenham and Bodoni M are the most legible 
in three faces while Baskerville is only average. 

In general there is a somewhat closer correspondence in the' 
relative legibility of the letters in the three faces with lower 
case than with upper case. Correlations were computed (rank 
differences squared) between the different columns of Table III. 
For the upper case the correlations are: Bondoni-Baskerville .47, 
Bodoni-Cheltenham .74, B a skervi lie-Cheltenham .63. For the lower 
case the corresponding figures are .73, .70, and .73, indicating 
closer correspondence in the case of the lower case letters. It 
would seem that upper case letters afford a better opportunity 
for face differences in legibility to manifest themselves. 

A record was kept of all cases in which a letter was mistaken 
for another. These were tabulated to show any common ten- 
dencies. No error was considered of interest unless made by at 
least two subjects. The following confusions occurred in all three 
faces: lower case E read C; lower ease H read B; upper case I 
'read L; upper case R read K. The following confusions occurred 
in two faces, lower case; F read I, T read 1; and the following in 
two faces, upper case: B read C; M read W; P read F. There 
was nothing in the analysis of results from this standpoint to 
clearly indicate differences in face. 

SUMMARY 

A study was made of the comparative legibility of Bodoni, Bas- 
kerville Roman and Cheltenham Medium type faces. The legibility 
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of individual letters was determined separately using upper and 
lower case and fourteen point. The letters were presented in 
a focal variator and evafuated in terms of the distance they could 
be thrown out of focus (maintaining constant size) and atill be 
recognized. 

Greatest legibility was found on the average for Chclte&liam, 
followed by Baskerville, with Bodoni the least legible. This was 
tiue for both upper case aiul lower case but the differences were 
more striking from the standpoint of probable error with the 
upper case. These differences seem plausible upon examiiuition 
of the three faces, particularly with refenence to the width of 
strokes. Study of individual letters showed a tendency for the 
greatest differences between faces to occur vjith letters involving 
light strokes, inasmuch as these are particularly light in the 
Bodoni and Baskerville. 



A COMBINATION MENTAL TEST FOR CLINICAL 
USE 

By Grace H. Kent 
Worcester State Hospital, Worcester, Mass. 

I. LIMITATIONS OF STANDARD TESTS, FOR DIAGNOSTIC 
PURPOSES. 

The serviceability of mental tests for tentative classification of 
large groaps of persons has been established beyond reasonable 
doubt and there are many testa in common use, both individual 
and BTOup, which are sufficiently accurate for such purposes as 
classification of army recruits, school children, or factory em- 
ployees. But in the clinic no mechanically applied teat should be 
expected to take the place of patient and painstaking individual 
study. Used as an instrument for such study the standard test 
may be a valuable aid; but it is of questionable value if we accept 
the findings as final and thus make it serve as a substitute for 
careful observation. 

The concept "mental age" is an exceedingly convenient one and 
it is not unnatural that a servant so obliging should be expected 
to work over-time. Because the mental age can be so easily stated, 
it is almost inevitable that its significance should be exaggerated. 
Thus we find a tendency to speak of a child's mental age as if it 
were as definitely and finally determinable as his life age and there 
is danger that the qualitative findings of the test — which may be 
vastly more significant than any results that can be stated in fig- 
ures — will be wholly overlooked. 

An unavoidable source of error in the use of a norm is that it is 
impossible to give due recognition to the variations in the indi- 
vidual records from which the norm is constructed. The norm may 
be derived from a sufficiently large number of representative per- 
sons, but the individual variations still remain and the limits of 
possible normality lie close to the extremes rather than near the 
average or median.' 
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■lid not fiillr ai>pn.t;la(e (lie liu|iiirlaDce ut llii- l<iu1ll^^ltl■■^< thus Indk-iitril. 

uer ceni of all ri'arllciuH. nod the iiTcriiKi; fiir Idhbiii- huIiJccIk whh twcnt)'- 
Kevcn PIT com. Tills Is iilivlously ii Hlunlfli-ani dlffcri'iKi', hut v.e innniit 
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Another source of error which should be kept in mind is the 
personal equation of the examiner. This factor is well eliminated 
in many group tests by reducing the administration of the tests and 
the scoring of results to a purely mechanical process. But it cannot 
be 80 easily overcome in individual tests because much depends 
upon the inflection with which the examiner reads a question, and 
upon the spirit and interest with which he presents a problem. 
The teat may be so fatiguing to the examiner that he is unable in 
the latter part of the working day to do full justice either to the 
test or the subject. And in spite of the scoring cards and minute 
instructions which add more to the diflkulty than to the accuracy 
of scoring, there remains considerable room for difference of opin- 
ion, especially in teats calling for involved verbal responses. 

In order to be valid for adult subjects a test should be based in 
part upon faculties that develop with increasing maturity and 
-experience as opposed to those faculties that reach their zenith 
during the high school period and fall into disuse after school life 
is completed. If we are to depend largely upon tests for diagnosis, 
we should have a test that would show in what way a deficient man 
having a "mental age" of nine years differs from a normal boy of 
nine. We know that the man lacks the developmental possibilities 
which constitute the boy's chief asset to society. We know alao 
that the man, by reason of his longer experience and more settled 
habits, can do many things which the boy cannot do. We indicate 
the man's inferiority to the boy by assigning an intelligence quo- 
tient of fifty-six; but our criteria for determining his intellectual 
status are not adequate unless we can show also in what ways ha 
is superior to the boy. Determination of the mental ability which 
is measured by the Binet scale, call it what We please, does not tell 
us what we need most to know about a clinical subject. The man of 
thirty who gives a nine-year mental rating may be a useful and 
trustworthy laborer, or he may be a serious menace to society. 
Two thirty-year men of nine-year mentality, equally free from de- 
linquent tendencies, may differ very vridely in their capacity for 
work, in their adaptability to different kinds of work, and in the 
amount of supervision required. The fact that they give the same 
mental rating is relatively unimportant since the proper disposal 
of their cases depends upon distinctions which are not shown by 
the test. 

It is difficult to over-state the possible errors involved in the use 
of a verbal test for subjects who do not understand the language 
in which the test is given. It is true, under certain conditions, that 
a child's ability to acquire language may furnish a fair index to bis 
intelligence, but we cannot make^his assumption in a given case 
unless we know that the subject has had adequate opportunity to 



COMBINATION TEST FOR CLINICAL USE 248 

scqnire the lan^age. I recently tested many children in a mill 
village of which the foreign population is in the majority. The 
children use their own langnagfe at plsy, even on the school grounds, 
and many of them have rarely heard a word of English outside of 
the school room. To assign a mental age based on such showing as 
they can make in a verbal test would seem little short of perjury. 
Performance tests are useful in such cases, but more for qualita- 
tive interpretation than for mental rating. 

A test Btands on its own merits, regardless of norms, since the 
findings obtained by an unstandardized test that is well suited to 
the subject are more significant than a mental rating derived from 
an ill-adapted test. Dr. Walter E. Fernald's questions on "Prac- 
tical knowledge" possess certain advantages over any standard- 
ized test known to me. Although they cover a wide range of 
difficulty, these questions can be asked casually and answered 
aimply, usually in a very few words. They relate largely to mat- 
ters of local interest, and the child may easily assume that the 
examiner is seeking information on the matter inquired about. 
There is no definite programme for asking the questions, as for 
administering a more formal test, so the examiner is free to omit 
any question which does not fit the case and which might make the 
subject feel strained and unnatural. I should like to see these 
qaestions standardized, but not unless it conid be done without de- 
stroying the elasticity of the system. For although a norm is a 
great convenience to the examiner, it ia not essential to the serv- 
iceability of the teat. The age value represented by a given question 
or task is empirical, not absolute, and the examiner's own experi- 
ence ought not to be wholly at a discount. When a test — even a 
standard test — is used by an experienced observer, I question the 
advantage of rigid adherence to rules. 

No teat can be considered valid except on the assumption that 
the subject answers each question as well as he can. But it fre- 
quently happens that a subject who is brought to the clinic for 
examination comes very unwillingly and with no intention of giving 
any information about himself. The tactful examiner can usually 
obtain aome measure of responsiveness, but it ia imposaible to state 
the exact degree of co-operation received. The lack of co-operation 
cannot be estimated in quantitative terms, while its effect on the 
mental rating is invariably quantitative. 

Among insane subjects one meets with all possible degrees of 
co-<>peration. Some patients put forth their maximal effort in the 
hope of proving their fitness for life in society, some offer violent 
resistance, and some give no response at all. There are many cases 
in which the qualitative findings are of considerable interest, bat 
it is exceptional to find a patient for whom the mental rating, as 
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such, has any significance even as a matter of record, still less for 
diagnosis or treatment. When the rating is high enough to ex- 
clude mental deficiency, this diagnosis is almost certain to be 
excluded also on other grounds. A low rating may indicate defi- 
ciency, deterioration, or poor co-operation. Extremely wide scat- 
tering of success and failure is usually associated with a psychotic 
condition, but it may indicate merely that some of the problems 
presented are interesting enough to command the co-operation of 
the subject while others are beneath his notice. 

The examiner who administers the test usually learns something 
about the case but not necessarily anything that can be stated sta- 
tistically. In many cases it would be grossly misleading to assign 
a mental age. 

II. INHERENT WEAKNESS OP THE STANFORD 
REVISION, FOR CLINICAL USE. 

No single system of tests is equally well adapted to all classes 
of subjects. The Binet scale is especially adapted to children of 
normal mentalitv, and in this field I can agree with Terman that 
"In the large majority of cases persistent silence deserves to be 
scored failure," School children are in general the most responsive 
subjects I have ever had occasion to test, not excepting psycholog- 
ically trained university students, and the matter of obtaining their 
co-operation is not a serious problem. 

But this does not hold for clinical subjects, even when they are 
tested in school. The mental measurement of defectives requires 
a much finer technique than is necessary for the classification of 
normal children, and at best there is serious danger of rating a 
child too low. The younger children who are brought to the school 
clinic are apt to be timid in the presence of a stranger, and the 
older ones are usually suspicious and sensitive. Defective speech 
is very common, frequently serious enough to make the child shy 
and self-conscious, and sometimes so marked that his answers are 
unintelligible. Deficient children are very susceptible to fatigue, 
and the examination is usually too long, except for a child rating- 
very low, to be made properly at One sitting. 

When the external conditions are favorable and when there is 
no lack of time, I find the lower end of the Standford scale fairly 
satisfactory for testing English-speaking children who are free- 
from speech defect. If a child is too young to realize that he is 
being tested for mental deficiency, it is merely a question of time 
to overcome his diffidence and to gain his confidence. He regards 
the test as a school exercise, and responds to the examiner as well 
as to a new teacher. 

Many of the difficulties encountered in the clinical use of the 
scale are clearly recognised by Terman and cited as exceptional. 
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situations which should be met by some special mode of procedure.' 
But in the clinic these difficult situations are the rule ratber than 
the exception, and the means sugfgrested for overcoming them are 
usually impracticable. Under ordinary clinical conditions, as when 
the children are broug'ht from a distance or when they are exam- 
ined in school by a visiting psychologist, it may be impassible to 
take the child out for a walk in order to establish a friendly feel- 
ing, to allow two sittings for an examination, or to resort to any 
of the measures prompted by common sense. A full "Out-Patient 
Day" is not conducive to accurate work. The examination is us- 
ually too hurried to be satisfactory, and after four or live equally 
unsatisfactory tests performed in quick succession the examiner 
may be too tired to take proper interest in subsequent tests. 

My principal objection to the lower half of the scale when used 
for Juvenile subjects is that it requires conditions more perfect than 
usually obtain in the clinic — more perfect than I have ever seen 
in any clinic. But for any subject able to go above the eight-year 
level and for an adult subject of any grade of mentality, the de- 
fects of the scale are more serious and more fundamental. 

Perhaps the most delicate situation which we meet in the psy- 
chological clinic is that presented by the examination of a self- 
supporting young man or woman of border-zone intelligence, who 
requires supervisory care because of some problem relating to con- 
duct. The subject may be painfully aware of his intellectual short- 
comings, and the humiliation of being tested for mental deficiency 
is almost more than he can bear. If the test is to be valid, we should 
be able to offer something sufficiently interesting to draw his atten- 
tion away from himself as a su bject- who- is-s us pected-of -being- 
feebleminded. But the tasks of the Stanford scale are strongly 
conducive to self-consciousness, especially the questions relating to 
school life. It is little less than inhuman to require a serious 
answer to the question "What should you do if in danger of being 
late to school?" 

The vocabulary test furnishes a good illustration of a test that 
is well adapted to school children but very poorly adapted to the 
clinic. A bright boy may regard it as a joke when his limit is 
reached, and I have never seen a normal child manifest serious 
annoyance over the series of failures with which the test is invari- 
ably brought to a close. But these failures are disheartening to 
the sensitive clinical subject, and the situation becomes more tense 
with each succeeding question. The test is. therefore, unduly 
fatigniiug both to subject and examiner. 

The UsiButemcnt ot IntelllKeDce, psgCB 124 to I3S. 
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It ia not necessary to consider each question individually.' The 
fundamental weckncss of the system is that too little account is 
taken of the affective reaction of the subject. Terman assumes, as 
did Binet, that the questions can be presented in such a way as to 
arouse the interest of the subject. But even if so, it is a serious 
defect of the system, for clinical purposes, that so much depends 
upon the presentation. Aa most of the subject matter is of no 
intrinsic interest to subnormal adults and adolescents, the resources 
of the examiner are severely taxed in the effort to make the test 
attractive enough to hold their attention. And the rules for the 
administration of the test, when they are followed literally, make 
the examination unduly lengthy and tiresome. The examiner is 
expected to cover one year wholly within the range of the subject's 
ability and one year wholly beyond his range, thus including at 
least twelve questions that are frankly nondiscriminative for him, 
besides many more that are probably so. It is these nondiscrimi- 
native questions that are most disturbing to the subject's emotional 
equilibrium. He is annoyed and discouraged by those that he can- 
not answer and frequently feels insulted by those which are so 
easy as to require no thought. 

It is of no small importance, in the interests of accuracy, that 
a clinical test should be easily and comfortably administered. At 
best a day's work in the clinic ia usually too exhausting to be 
done as it ought to be done. One who is engaged in collecting 
material for a new test of his own devising may well think not- 
ing of working eight or even ten hours at high tension, because 
all thought of fatigue is overshadowed by the exhileration of 
watching the returns come in. But it is very different to spend 
a whole day making routine use of that same test after it has 
been published, and still more different to spend a day iHfMfip 
routine application of a test for which one has no personal af- 
fection. Much of the routine testing in clinics is done by persmu 
of comparatively little training, who have no vital interest in tbe 
results and who are not qualified to make construetive use of 
their observations. And if their work is made unreMonably dif- 
ficult, it is conceivable that some of them will ligliten the burden 
by taking unwarrantable liberties with the technique. 

ni. SUGGESTED CHITERIA FOE CLINICAL TESTS. 

It is much easier to point out defects in the tests we ftie uaiqg 
than to devise methods for correcting them. Most of my reooqi* 
mendations are negative, but it can do no harm to call attention to 
the particular needs of the clinic. 

1. The task or problem should possess aufflcient intrinsic ip- 
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terest so that the subject will usually regard succeasfnl perform- 
ance as an end in itself. Spontaneous co-operation on the part 
of the majority of subjects should be considered essential. It is 
not to be expected that any test will meet with universal approval 
among clinical subjects, but there should be no tasks which are 
commonly performed only in response to urging. 

2. Any test used for examination of adult subjects of what- 
ever grade of mentality should possess sufficient dignity so that 
it can be offered to a mature, self-respecting man without insult- 
ing him. Questions should relate to politics, travel, the industrial 
world and other subjects of universal interest rather than to school 
life. All material that is essentially puerile should be rigidly ex- 
cluded. 

8. The requirements for each task should be simple and easily 
understood so that it may not be necessary to tax the attention 
of the subject by a long and involved explanation. Repetition 
flhould not be necessary and the time required for presentation 
should be negligible. 

4. Questions which call for oral response, if used at all, should 
be satisfied by very simple answers. 

6. The administration of the test should not be so exhausting 
as to make it impossible for an examiner in ordinary health to 
put in a full day's work of evenly good quality. Progressive de- 
terioration in the quality of presentation should be avoided by 
the use of tests that can be presented with the minimal amount of 
actual labor. There should be very few tests, if any, which re- 
quire the reading aloud of long paragraphs, and very few per- 
formance tests which call for close observation of the subject's 
movements. No tests should require hair-splitting distinctions as 
to what constitutes an erroneous movement. 

6. Time limits are necessary in order to prevent an examination 
from being too long and tedious. But the time allowance in most 
tests should be liberal enough so that the subject will not be con- 
scious of working under a time limit. Many normal persons are 
nnable to do themselves full justice when working under high 
pressure, and it is unfair to class a person as deficient primarily 
on the ground that he becomes disconcerted when hurried. 

7. Tests which call for reading knowledge on the part of the 
•nllject have a relatively small place in the clinic. Adult subjects 
who can read a little are usually very sensitive about their in- 
ability to read fluently, and the exposure of the deficiency in read- 
ing knowledge may be so disturbing emotionally as to invalidate 
Ijke rest of the examination. Also, there are many clinical sub- 
jd-ta Tho cannot read at all. 

8. Tosts which elicit obvious failures should be avoided as far 
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ai possilfle. Such errors as are necessary to make a test dis- 
criminative should be interspersed among successful performances, 
so that the subject will not be discouraged by the sense of failure. 
Tests in which the subject will be wholly unaware of his errors 
are especially valuable. (Healy Pictorial Completion II furnishes 
proof that this is not impossible. A subject may make ten er- 
roneous placings which net a minus score, and yet be perfectly 
satisfied with the result) . 

9. A scale of tests intended for clinical use should be of rather 
loose construction, so that thoroughness of the examination may 
not be dependent upon any particular test or group of tests. The 
system of scoring should permit giving the subject a rating on 
tests that are well suited to his command of language and his 
ability in general. It should not be necessary to give him a test 
that is hopelessly beyond him merely to prove that he cannot pass; 
nor, on the other hand, to give a teat that he will take as an insult 
to his intelligence merely to prove that he can pass. The general 
plan of standardization for performance tests in which s 
failure is obvious to the subject should be sucK that the e 
may permit or assist a subject to finish a task after the time limit 
is passed, so that the subject need not know of his failure to pass 
the test. And the rules for administration should be liberal enough 
to permit the examiner to select tests in accordance with the in- 
terests and ability of the subject. 

Other criteria, of course, are essential. But it is not necessary 
to enumerate here the various standards to which educational as 
well as clinical tests are expected to conform. 

The development of a scale which shall satisfy these require- 
ments is a problem for collective rather than individual effort. 
However, individual contributions are not wholly at a discount, 
and at worst the problem is difficult enough to be intensely inter- 
esting. 

IV. A TENTATIVE COMBINATION SCALE 

This is offered somewhat prematurely, as a preliminary study, in 
the hope that it will encourage the splitting of composite educa- 
tional tests into their component parts and the publication of inde- 
pendent norms for the separate units. 

This plan for using a miscellaneous group of tests as a sub- 
stitute for a standard scale is essentially the method suggested 
by Pintner and Pateraon' for deriving a mental rating from a 
group of tests that were standardized more or less independently. 

It seems to me that we can make a closer approach to the true 
mental age — if there he any such thing — by basing the estimate 
upon the median of a number of independent mental ratings than 
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by accepting as final the rating derived from any single system 
of tests. I believe further that it is an advantage, other things 
being equal, to use tests drawn from different sources, developed 
by different authors, and standardized by results obtained from 
different sets of children. In this way the total number of normal 
subjects contributing to the norms is greatly increased, and certain 
constant errors, such as the personal bias of the experimenter, 
tend to be counteracted. 

It is only as a tentative measure that I am willing to accept the 
term "mental age" as the end result of the series of tests. I con- 
sider the term absurd as applied to adults, and believe it to be 
frequently misleading as applied to children. It is far too readily 
understood, and is therefore used loosely by persons without psy- 
chological training. Worst of all there is a strong tendency to 
pass it around carelessly among workers in the clinic, sometimes 
within the hearing of a subject who is capable of comprehending 
its meaning. But although I strongly disapprove the use of this 
term and greatly prefer the percentile method, I find it necessary 
to express results of different tests in a term that will serve as a 
common denominator, and "mental age" is unfortunately the most 
convenient term for this purpose. My present aim, therefore, is to 
collect a large number of short-time tests which yield independent 
mental age ratings. 

An abbreviated form of the Stanford scale — usually two or oc- 
casionally three items for each year — furnishes one unit of the 
series. Healy Pictorial Completion II is an exceptionally valuable 
test for English-speaking subjects of high grade. Of the fifteen 
tests of the Pi ntner- Pater son performance scale, I find the fol- 
lowing especially useful: Mare and Foal Picture Board, Seguin 
Form Board, Five Figure Board, Two Figure Board, Casuist Form 
Board, Triangle Test, Diagonal Test, Ship Test and Substitution 
Test. Other tests which I am using already or expect soon to add 
to my collection are as follows: Kohs Block Design Test, Holley 
Vocabulary Test, Ferguson Form Boards, Cube Construction Test, 
Dearborn Form Board, Pressey Primary, Preasey Intermediate, 
Otis Intermediate, and selected tests from the Herring Revision of 
the Binet-Simon Scale.' 

The essential feature of the programme is that each task pre- 
sented to a subject can be selected with special reference to the 
interests and ability of this particular subject. Any test which 
doei) not elicit good co-operation is to be dropped, and the record, 
even if complete, is not to be counted in the series. 
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The teste used in any examination should be aa varied as the 
subject's ability and interests permit, and it is important to have 
a larger collection from which to draw, especially of verbal tests. 
If it were necessary to choose between lan^a^ tests and perform- 
ance tests I should sive the preference to performance tests, be- 
cause nearly all clinical subjects co-operate more readily in these 
testa than in tests requiring an oral response, and because there 
are many subjects who cannot be reached at all by language tests. 
But performance tests are limited in their scope, and many of them 
are highly susceptible to the influence of chance. They do not take 
the place of langua^ tests, for subjects who have fair command 
of the language and the frame-work of the method wilt not be 
complete until verbal tests are available in much greater variety. 
The verbal-performance tests which are now being used extensively 
in schools offer a wealth of material for this purpose. The Ter- 
man Group Test, for example, contains several units which would 
be exceedingly useful in the clinic, given aa individual tests. It 
will be necessary, of course, to compute norms for the separate 
units before they can be used in this scheme.* 

It is my plan to use in approximately equal proportions tests 
which depend upon accuracy aAd testa which are scored by speed. 
While it is of course impossible to distinguish between these two 
variables in a strict sense, I think we are justified in disregarding 
one or the other in practice. In those performance tests in which 
the performance leaves no record of the errors, the difficulty of 
counting the subject's moves introduces a source of inaccuracy 
which it is particularly desirable to eliminate, since there is no 
way of checking up the examiner's count. In the Pintner-Paterson 
tests which I am using most freely, the error curve runs almost 
parallel to the time curve. It is true that the time record does not 
tell the whole story, but 1 cannot see that the count of moves or 
errors adds anything to it, and I think the examiner's time can 
be spent more profitably taking notes for qualitative study of the 
subject's mode of procedure. In giving the Koha test recently to 
adult subjects of very superior ability, I observed that some toyed 
aimlessly with the blocks, thus making many useless moves; some 
worked by trial and error, moving ao rapidly that I was unable 
to count the moves with even an approach to accuracy; and some 
worked very deliberately, with almost no false movements. All 
gave high scores, and the number of moves depended, apparently, 
more upon temperament than upon the ability measured by the 
test. 

>I am Imlcliteil (o Dr. I.uelln Cole ITfhb?; for proildlnK me with Bge 
naruiM tor tlic (unr partx <■( the rruuse; Trlninry leaC. ThU iDmlahei four 
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The mental ratings obtained from a given subject by different 
tests asually vary quite widely, sometimes ranging from sixteen 
years to zero. This may be due in part to the influence of chance 
upon some of the mechanical performance teats. But as the rat- 
ings which are affected by chance tend naturally to approach the 
^tremes of the series, they do not invalidate the final result. In a 
series of fifteen tests it ie not uncommon to lind the middle four 
or five figures almost identical. If the ratings are fairly uniform 
I consider a series of ten tests sufficient, and I have occasionally 
assigned a mental age on the basis of nine tests. Ordinarily I 
prefer to make at least twelve tests. 

The mental age as finally recorded is the median mental rating 
of all the testa — never less than nine — which are clearly discrimi- 
native for the subject, exclusive of any tests in which he does not 
give good co-operation and any tests which are too easy or too 
difficult to measure his ability. In the Manikin test, for instance, 
the highest possible score has a mental age value of eight years. 
If this record were counted in the series of a subject rating over 
eight years, the median would be lowered one point, and it would 
be absurd thus to penalize a perfect record. A test so difficult as 
to yield a zero score would have exactly the same effect upon the 
median, and it would he possible in testing a subject of low grade 
mentality, to give enough too-diflicult tests to bring the median 
down to zero. A zero score does not necessarily prove the test to 
be non-discriminative, but I count the test too difficult to be discrim- 
inative when the subject works persistently up to the time limit 
withont making any appreciable progress toward success. The 
examiner's errors in selecting the teats ought not to be counted 
against the subject's mentality, and it is clearly unfair to include 
these records. 

By beginning with a test having a wide range of discriminative 
capacity and gauging the subject's ability by the results of the 
first test, it is usually possible to avoid giving non-discrimina- 
tive tests. For a subject of low grade mentality I usually 
begin vrith the Seguin form board or the Mare and Foal picture 
board. For a subject of high grade the Kohs Block Design test 
is very satisfactory for the first presentation, because of its wide 
range of applicability and especially because of its unusual attrac- 
tiveness as a toy. 

SUMMARY 

An indefinite series of short-time mental tests, verbal and per- 
formance, is recommended for use in the clinic as a substitute for 
a fixed scale of tests. Any short test for which an independent 
age norm is available may be used in the series, and the mental 
age is derived by taking the median rating of ten to fifteen testa 
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which are clearly discriminative for the ability of the subject. 

Many composite educational tests which are not suitable for 
clinical use in their entirety contain parts that would be highly 
valuable as single units of a series. The publication of norms for 
small homogeneous units, in addition to the norms regularly pub- 
lished, would be conducive to the wider usefulness of tests intended 
for educational surveys. 

The following advantages of this method over the Stanford Re- 
vision have been observed ; 

1. The method is more elastic than a fixed scale, more adapt- 
able to the interests of the subject. By selecting tests that are in 
line with his interests, it is possible to obtain better co-operation. 

2. The method is adaptable also to the special qualifications of 
the examiner for administering tests, and the routine work of 
testing is thus made more attractive and less fatiguing. 

3. The method is less mechanical. By allowing more room for 
common sense in dealing with a subject, it is conducive to more 
careful observation of the patient as an' individual. 

4. By placing less responsibility upon the examiner for the ob- 
servance of petty rules, it reduces the chances that undue liber- 
ties will be taken with the technique of examination. 

5. If the tests are well selected, it allows leas play of personal 
equation in the scoring of results. 

6. It is more economical of time. The period is spent upon 
tests that really test the ability of the subject in a given direction, 
and no considerable amount of time is wasted upon tests that are 
either too easy or too difficult to show definite findings. There is 
also an absolute saving in the time required for testing a subject 
of high grade mentality. 

7. The validity of the results is not dependent upon the sub- 
ject's co-operation in every test presented or in any particular test. 
If he can be induced to co-operate in any ten tests, it does not 
matter, for the validity of the test, how many questions he refuses 
to answer. 



FRESHMAN TESTS IN THE SMALL COLLEGE' 

By Elsie Murray, 
Wells College 



In thia era of rapidly expanding college populations and chang- 
ing standards in entrance requirements and curricula, the uses of 
a freshman intelligence t«st are manifold. In the smaller college 
admitting by certificate only, one may desire a criterion by which 
to gauge the quality of successive entering classes of entrants 
with and without Latin; or of students in the college in point with 
those in other institutions. The test findings are also utilizable in 
connection with student guidance, to detect special abilities or dis- 
abilities, and to throw light upon cases of academic failure. There 
is, besides, the possibility of discovering a test combination which 
may later prove of value in the selection of desirable (or the elim- 
ination of undesirable) candidates for admission. 

With all of these objectives more or less in view, a freshman 
group intelligence test was given at Sweet Briar College, in the 
fall of three successive years: November 20, 1919. to 149 fresh- 
men (class of 1923); October 26, 1920, to 116 freshmen (1924); 
and 29 seniors (1921); October 19, 1921, to 116 freshmen (1925) 
and 32 seniors (1922). The blank used was the Thurstone Psy- 
chological Examination for College Freshmen, in its 1919 form 
in 1919, and in the 1920 form in 1920. This test, which is ar- 
ranged in 'cycle-omnibus' form, with a single time limit, requires 
only 30 minutes, and calls for no formal oral instructions. It was 
administered simultaneously to groups of about 40 each, by in 
structors coached by the writer. 

Out of the various possibilities available in 1919, this particu- 
lar blank was selected for trial, in part because of ease of admin- 
istration, and economy of time and expense; largely, however, be- 
cause the types of problem represented (anahgies, information, 
matching of abstract etate'menta, judgment on tke truth or falsity 
of arguments, sentence completion, completion of number series, 
in the 1919 edition, the same with the substitution of an extra word 
test, and arithmetical problems for the two last mentioned, in the 
1920 edition) , had previously proved highly reliable in the writer's 
testing of college women (juniors and seniors).' As compared with 
Army Alpha, the Thurstone combination seemed better adapted to 
call out genuine and sustained thinking ability on the part of the 
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student tested. In the long run, we must admit, tha aentence com- 
pletion test in the 1919 edition, and the arithmetical problema of 
the 1920, were found to constitute a serious obstacle to our use of 
this test. Not only does the substitution of the latter problems for 
the former invalidate the comparative value of test scores in snc- 
cessive years, but the wide variations in the possible solations of the 
former (of quite different qualitative value), prevent any con- 
stancy in scoring from year to year. As regards the arithmetical 
problems, many students finding them to consume a dispropor- 
tionate amount of time, simply omitted them entirely, thus running 
up relatively high scores for speed (problems correct) as com- 
pared with those of more conscientious individuals. 

RAW BBSILTS. TRKATUENT OF SCOEEa. DISTRIBUTION. 

Of the 443 students tested, only three covered the blank (168 
problems in the 1919 edition, 182 in the 1920) within the time 
limit set. Among the seniors, no one scored higher than 152 cor- 
rect out of 168, or 144 out of 182 among the freshmen. The test is 
therefore approximately long and hard enough for the group con- 
cerned, in the time allotted. 

The pedagogical difficulty of handling students of widely vary- 
ing mental calibre in a single section is a commonplace in educa- 
tion. In view of this, the range of scores within each freshman 
group is worth remark. The speed and alertness indicated by the 
upper scores (in problems correct and problem» covered) is two to 
three times that represented by the lowest scores (see Table I). 
The range in proportion of errors and omissions to problems cor- 
rect, as measured by percentage accuracy, is also striking, though 
less extended (56 to 9&% for 1923). 

The importance of calculating the percentage accuracy as well as 
the number of problems correct was first suggested by the fact 
that certain of the problems are couched in such a form that mere 
guesswork may yield a considerable number of successes; secondly, 
by scrutiny of the academic records of individuals in whom a 
relatively good score in speed or problems correct was observed to 
be accompanied by a relatively high proportion of errors. In 
many such cases, academic success or failure was found to bear 
a closer relation to the score in accuracy (number .correct divided 
by number covered) than to the score in problems correct. E. g,, 
in 1923, in more than half of the cases of striking dislocation be- 
tween decile rank in grades and in tests, the discrepancy is con- 
siderably reduced by substituting rank in accuracy for rank in 
problems correct (see Table VIII). It seems not unlikely that 
while the latter may constitute the better measure of mental alert- 
ness and agility, in certain fields, the former (percentage accuracy) 
is a truer gauge of all-round ability, or at least of certain character 
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traits-stability, perseverance, effort, ambition, and the related 
qualities, which enter ao largely into the determination of academic 
sDCcesB. 

Accordingly, after considerable experimentation with scores and 
correlation coefRcients, the method was adopted of computing ani 
'adjusted score,' by subtracting the sum of the errors and omis- 
sions from the number of successes. The coefficient for these 
'adjusted scores' and freshman grades ranges from +.42 to +.44 
for the different classes, and is always higher than that for the 
speed scores (e.g., for 1924, the correlation for academic grades 
and number of problems correct is only .375; for grades and ad- 
justed scores, .42). Each class was then split into ten equal sec- 
tions or deciles, on the basis of this score, those in the highest 
decile given a rank of 10, those in the lowest of 1, etc. Decile 
ranks were similarly determined for each student both in problems 
eorreet, and in accuracy (later, in faculty estimatei and in grades) 
and a copy of the whole placed on file in the registrar's office for 
consultation by instructors and faculty advisers who desired 
further light on backward or promising students. 

This adjusted score, it is obvious, raises somewhat the standing 
of the 'slow but sure' individual, (over the fairness of whose 
rating in a speeded test those unfamiliar with mental measure- 
ments feel such concern), as it also lowers somewhat the rank of 
the slap-dash, swift but careless; and there becomes thus available 
a set of three score rankings, which furnish jointly a more satis- 
factory mental picture of the individual than any one taken singly. 
The usual combinations of swift and inaccurate, slow and accurate, 
swift and accurate, and slow and inaccurate, obtain. While decile 
combinations of 6-1-3, 1-9-4, etc., for speed, accuracy and adjusted 
score, are not uncommon, and the correlation coefficient for speed 
and accuracy in 1923 was only .37^, there are also noteworthy 
cases of 10-10-10 and 1-1-1 (see Table II). 

COMFABtSON WITH FRESHMEN SCORES IN OTHER COLLEGES 

The average score in problems correct for 1923 is 85.4. This 
falls a trifle below the corresponding averages quoted by Thurs- 
tone* for Liberal Arts and Engineering freshmen — 86.6 and 88.8. 
respectively. The average for 1925, using the same test form. 

If Educn- 
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TABLE I 

DISTRIBUTION OF' SCORES IN FRESHMAN TESTS, 443 

Freshmen Seniors 

Class 1923 1924 1925 1921 1922 

No. Students 149 116 116 29 32 

No. Problems 168- 182" 168* 182" 168* 



Highest Score 168 

75 Percentile 119 

Median 108 

25 Percentile 94 

Lowest Score C3 

H 168 



169 168 



182 



107 113.5 119 



143 144 132 140 152 



' Percentage 
Accuracy 



118 123 124 131 136 Adjusted Score 



1919 edition of test. 
■ 1920 edition of teat. 
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rises to 90, a flgrure slightly higher than either of Thurstone's 
BVera^B. There is, however, a weak spot in these comparisons, — 
the Sentence Completion test, which occurs in the 1919 edition, and 
the scoring of which it has proved impossible to standardize fairly. 

MEASUREMENT OF IMPROVEMENT IN SUCCESSIVE ENTERING CLASSES 

In theuse of the teats to measure the mental calibre of succes- 
sive freshman classes, the scoring difficulty above mentioned again 
arises. However, the scoring standard for sentence completion in 
1921 was apparently more severe, operating if at all to lower tlie 
score for the class of 1925, since the median number of correct 
answers for this type of problem remains stationary for this 
class, while the medians for all other problems rise a point or two. 
TABLE II 

BEST RECORDS WORST RECORDS 

No. Adjusted No, Adjusted 

Correct Accuracy Score Correct Accuracy Score 

1923 Score 120 90% 115 52 56.5% 12 
Decile Rk. 10 10 10 1 1 1 

1924 135 91 122 56 46 -10 

10 10 10 1 I 1 

1921 (Senior) 136 96.5 131 53 65 10 



10 10 10 1 1 1 

1922 (Senior) 152 90.5 136 105 62 46 

A second hitch arose from the altered form of the test offered in 
1920, the arithmetical problems of which proved a stumbling block 
to our students, many of whom possess a veritable 'number 
phobia.' The median score for this year drops in consequence 3 
points instead of rising, although the general academic record of 
this class is above that of 1923. A certain degree of improvement 
in 1926 aa compared with 1923 is, however, clearly discernible 
(see Table I and IV> ; median and lower limits are both higher, 
though no individual in 1926 attains as high a score as the best in 
1923. 

In Tables III and IV, the relation of senior and freshman 
groups is presented. Since the best senior scores barely exceed 
the best freshman, the claim of the intelligence test to measure 
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native endowment rather than acquired ability or knowledge would 
seem to be substantiated.' Only the information and analogy 
scores of the seniors ascend disproportionately; the latter perhaps 
because of familiarity with similar tests gained in Psychology I. 
The bulk of each senior class ranks in the highest qoartile of the 
freshman class subjected to the same edition of the teat This is, 
of course, as it should be, through the natural process of- selection 
and elimination of the weaker operating over three college years. 
There remain, to be sure, in the senior classes a number of strag- 
glers in the lower quartiles whose academic statna ia for the most 
part as unsatisfactory as their intelligence rating. 

In order to check the operation of selection Tersus training more 
exactly, in January, 1923, when the freshmen tested in 1919 were 
seniors, the number of survivors in each of the original quartiles 
was tabulated (see Table III). The percentage of the survivors 
ranking above the median was found to be only 61 per cent, a 
figure somewhat below that for senior-freshman comparisons when 
two classes are tested simultaneously, the former in their senior 
year <84%). The 25, 50, 75, 100 percentiles for 1923 seniors were 
also found to average only about 6 points higher than those for 
the same group as freshmen, although the discrepancy between 
senior and freshman medians for 1922 and 1925 (tested simul- 
taneously) was 18 points. Granted that the quality of entrants 
has not deteriorated from 1917-1921, individual improvement would 
seem to play a more important role than selection in raising senior 
scores.' Even so, the rise to be credited to senior superiority in 
training — in knowledge, aplorab, concentration, grasp, or what not 
— say 10 or 12 points on the average, forms only a fraction of the 
total range of difference in abilities in the original croup (9* ** 
100 points). In other words, three years' college trwmn» woiild 
KfaU, presumably, ty shift the rank of a given individnal hudly 
» eonple <rf deciles — a conclusion borne out by the records oi re- 
Lltie sophomore year, where the averaKB g«l>* ■PP"** 
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TABLE III 

RATING OF SENIORS WITHIN THE FRESHMAN QUATtTU.'ZS. DISTRIBUTION 

1921 1922 1921 1922 1923 

Fcr ProbleiMS Correct Per Adjusted S:::im Cjrrect, Adj. Score 
Qnartile* Frequency 

IV 17 21 18 20 13 11 

III 7 9 7 7 10 10 

II 2 2 1 4 8 9 

I 3 .... 3 1 3 4 

Total 29 32 29 32 34 

Above median, 24 30 or 26 or 27 or 23 or 21 or 

or 83 pr ct. 93 pr ct. 86 pr ct. 84 pr ct. 86 pr et. 61 pr ct. 

'QuartUe rank in terms of 1924 freshman records for 1921, seniors 
in terms of 1925 freshman records for 1922, seniors 
in terms of 1923 freshman recordB for 1923, seniora 

LATIN ENTRANCE CREDITS AND INTELLIGENCE RATING. 

In order to estimate the possible detriment to the student body 

of altering the oonventional Latin entrance requirement of the 

eastern ealieges, both intelligence rating and academic standing 

for the freshman and sophomore years of students whose entrance 

certificates showed respectively 4, 3, 2, 1, or Latin credits were 

tsbalated. As shown in Table V, the median intelligence rating 

of those offering the standard number of unita (4) is only slightly 

above the rating for those offering fewer. Further, the individuals 

of the two groups are similarly distributed over the ten test 

deciles, and the ratio of students above and below the median is 

practically the same (1 to 1) in each division. Adhering to the 

old 4-point Latin requirement would have cost the college 6 out 

of 16 of the most promising members of 1923; 4 out of 11 of 1924; 

■pd 2 out of 12 from 1925. If the intelligence test is a reliable 

iadicator, the 4 unit Latin requirement is no longer the sieve for 

eliminating the weaker students which it seemed to be ten or 

ilftecn years ago, when the brighter minds in the secondary schools 

lynrv urged to complete the four years of Latin in the classical 

g^sttWK, and failure to do so was a fair indication of either sloth 

^If ivtnpidity. This requirement now cuts out the sheep along with 

jft^ .areata. 

jp'^rom the point of view of academic success, at least in the 
I, an4 tre^n^an years, the comparison of the reduced 
■.1ft i^th th^ standvd group is less favorable. The median 
:S^ for Um farmer is somewhat lower, the number of students 
^^e tt» dass average proportionately smaller. ' At the same 
9, the students of this group range through all the deciles of 
dt« rank, and their elimination through a 4-point entrance re- 
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quirement would have coat the class of 1923 B out of its best 13 
students; 1924, 1 out of 13; 1925, 3 out of 11. 

Assignment of the reasons for the slightly lower academic 
achievement of the Sweet Briar student with reduced Latin en- 
trance would be impossible without a fuller analysis of the con- 
ditions governing admission than is here practicable. There Is, 
however, no real evidence that it indicates that the lack of Latin 
handicaps the student in either linguistic or scientific studies.' It 
may indeed signify that the steadfast pursuit of Latin studies is 
still in a degree a measure of the scholastic ambition and energy 
of the special group of students who apply to Sweet Briar for 
admission. This latter view would, in fact, seem to be supported 
by the falling away of 3-0 point Latin entrants in the sophomore 
year, as compared with i point — see Table V, in which the ratio 
of the former to the latter drops from roughly 1-1 to 1-2 for 1923, 
from 3-5 to 1-2 for 1924, in the sophomoi^ years as compared with 
the freshman. This falling off is not, however, to be ascribed 
entirely to lack of scholarly ambition. The inability to obtain an 
A.B. degree on less than the full Latin entrance requirement 
operates either to discourage students from continuing in college, 
or to encourage their transfer to other institutions, e.g., state 
universities, where the lack of Latin is not a handicap. The effort 
TABLE V 

LATIN ENTRANCE CREDITS AND INTELLIGENCE RATING 
FSEt)UENCY OF CREDIT GROUPS 

Class No. 4 3 2 1 Tot. 0-3 Credits Year 

Freah-1923 149 79 18 32 5 16 70 

man 1924 116 71 14 24 7 45 

1925 116 73 17 22 4 43 

1923 46 27 Sopho- 



1924 


44 




1925 


50 






CREDIT 


UNIT3 AND INTELLIGE 




Median Teat Deciles 


1923 


6 


6 G 4 


1924 


6 


5.5 4 


1925 


6 


5 6 

ACADEMIC RANK 




Median Grade Deciles 


1923 


6 


3 4 4 


1924 


6 


3 5 


1925 


7 


4 5 





Freah- 


Year 


ii:an 


1923 


.43 


1924 


.42 


1925 


.44 


1921 


.34 
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to make up the missing Latin credits in college in order to enter 
for the A.B. degree while carrying full freahman work also oper- 
ates to lower their academic status. In any case, It is obvious that 
the effect upon the intellig^ence level of the student body of Uwer- 
ing the Latin requirement has not been at all as dolorous as the 
Latin enthusiasts were wont to predict. 
TABLE VI. 

CORBBLATION OF TESTS AND GRADES 

Soph, and Jun., 

Fresh- Soph, and Jun. and Four 

No. man No. Fresh. No. Senior Years 
14G .43 W 78 .517 38 
112 .48 Go 

113 
21 .39 .481^ .48 

PREDICTIVE VALUE OF THE TEST 
Throughout the above discussion, the value of the Thurstone 
tcEt as an indicator of ability has been more or less assumed. It 
remains to examine its claim more minutely, to determine the exact 
degree of reliability of the test in relation to success or failure 
at Sweet Briar College. With this object in view, the test scores 
have been correlated with instructors' estimates,' and with academic 
grades for from 1 to 3 years. The test ratings of students drop- 
ping out and remaining in each class have been compared. A 
number of members of 1023 and 1924 have been re-examined with 
an alternative form of the test. Cases of marked discrepancy be- 
tween scores and academic ranks have been carefully analysed, and 
the health records of each class scrutinized for whatever light 
they may throw upon the problem. 

jllftli'iili.v iif Hi'CurlnK rnvulty (rKlIuintrH of lurflligCDrc ua any othi^r basis 
llinn iliiiL i>r rliiKH iiinrkK la ibe ili'parlnii-nt cunciTDi-d, Thu cortPlHllon of 
tvatf uiid iKtiiiiuiia fur IIKH wax .-13%, unly Vi polDI lilgliGT than that for 

■R<itn:rK. rciiiirting: 1X2 (lOncher freRhinva, Hnila o rorrplntlun at .UTA for 

the Thomdika l«ta mill fn-Khmuo (.-rade* ' " — " ' "■" '--• '-— 

oliuUiicy. Aiirll. WM. |i. ItU: Mentnl Twin 
rylni; Colli'Kt' SiudcntKk. Tlie nirrpliitini 
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Teat Scores and Grade Rank. After trying out and discarding 
various tnGt'nods of weighting, the following procedure was 
adopted. The letter grades ot each student for the year were 
converted into numbers (following the scheme A=ll, A— ^^10, 
B+^— 9, etc.) and the total obtained. This total instead of the 
usual average was then made the basis of a grade ranking, and 
correlation coefficients with test rating (based upon adjusted 
score) obtained. These coefficients (R, calculated by the Spear- 
man foot-rule, xL5) are shown in Table VL The figure for the 
first year grades is about the same for all classes, +.43, and ap- 
proximates that usually quoted for freshman groups of fairly 
homogeneous material,' When sophomore and junior grades are 
added, this figure ri^es to .517 for the 38 surviving members of 
1923. 

A clearer notion of the degree of correspondence (or divergence) 
between test and grade rankings may be obtained by dividing each 
class into four sections or quartiles, first on the basis of their test 
ratings, second, upon that of their year's grades. The number of 
students occupying a similar quartile in each set of measures may 
then be computed, also the number occupying the highest quartile 
in one and the lowest in the other, i. e., the number both of 
coincidences and of absolute disagreements in rank. E. g., as 
shown in Table VII, 22 individuals out of the 35 in the highest 
test quartile for 1923 rank also highest in freshma nscholarship ; 
14 out of 28 for 1924; 15 out of 28 for 1925. At the same time 
the range of academic achievement for any given degree of test 
performance is wide, and a few individuals from the lowest test 
quartile in each class attain the highest grade quartile, at least 
in their freshman year. The percentage of the group maintaining 
the same quartile rank in both sets of measures is 43 for 1923, 
42 for 1924, 39 for 1925.° This means that we would be absolutely 
right in the case of about 4 out of 10 students in predicting their 
quartile rank in scholarship on the basis of their quartile position 
in test rating; absolutely wrong in the case of only 3 or 4 out 
of 100 (these latter discrepancies being reduced or eliminated 
when the ranking is based upon the grades of latter years.) 

The corri'BpinUlng liuurp given liy Hogere 1b only 33%. Whelber thU 
InJlriltfB thf hlBlH-r rfltuMllty of our sron's, or llie less BPlected and homo- 



TABLE VII. 

QuABTiLE CoiNcnsNCE In Test And Grade Rankings 

A. 1923 FRESHMAN GRADES 



11 



15 



No. Subjects 35 37 35 37 

Total 144 

Coincidence 62(43%) 

Disa^eement 4(2.7%) 

B. 1923 JUNIOR, SOPHOMORE AND FRESHMAN GRADES 
IV III II I ToUl 



TESTS 



rv 

III 



1 



Total 
Coincidence 
Diaagreement 



C. 1924 FRESHMAN GRADES 



I 



No. Subjects 

Total 
Coincidence 
Disagreement 



D. 1925 FRESHMAN GRADES 



112 
47(42%) 
3(2.6%) 



I 



No. Subjects 

Total 
Coincidence 
Disagreement 



•Kill-i 



44(39%) 
6(5%) 



1 the baalB at 



FRESHMAN TESTS IN THE SMALL COLLEGE 
E. 1921 FOUR YEARS GRADES 



Total 21 

Coincidence 12(57%) 

Disaereement 2(9.5%) 

For the test ranlctng of those delinquent in studies at the end 
of the freshman year, also of significance here, see Table XI. For 
a corresponding group Thurstone reports delinquents to the num- 
ber of 0, 2, 3 and 9, for the test quartiles 4 to 1. 

What is the real significance of these figures? Can a test which 
yields a correlation coefficient of less than .80, a percentage 
quartile coincidence with prrades of less than 75, be of utility in 
a college office, either in the guidance or elimination of students? 
Should material or method be modified, or is the quest hopeless ? 

In answering this question, the necessity must first of all be 
emphasized of considering the grades for the entire college career 
of the student before passing judgment upon the test as prognostic 
of academic achievement. Grades, always tricky, are specially 
open to attack in the freshman year. First of all, there is the 
fallibiUfy of the hiKlniciiti-, pos-sibly too easily impressed by a glib 
memory, poiso of manner, a fluent tongue. Second, the iviriavce hi 
ranking standai-ds in different departments, illustrated by the fact 
that the median freshman grade in the various subjects ranges 
from C minus to C plus for 1924, from C plus to B minus for 1925 
(C=Fair, D=Oonditioned. B-Good) ; while tlic middle point in one 
subject rose from C minus in 1920-21 to B minus in H'21-32. 
Third, owing to a certain hititmle of ehu'ire in mibjcctn, even in the 
freshman year, deceptively high records may be achieved by 
students doing very little real brain work; especially in the case of 
courses based upon material already familiar to the well -pre pared 
student. 

There is'also to be considered the routine rliaraclet- of .niniy 
frcfhmnti cuifrnen, involving on the whole more of a memory gvind 
in gi;immar, formulae, !ind fact. Hum luter. more aiiviiiiced, and 
elective studies, which are per fe better fitted to evoke real it-ason- 
ing ability and initiative in the student. Lastly, from the point 
of view (if the individual freshman, there i.'i the eliiiotic chiiraetcr 
of the first year in college, involving as it does adjustments to a 
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native endowment t&ther than acquired ability or knoiriedce wonld 
seem to be substantiated.' Only the information and analogy 
scores of the seniors ascend dbproportiooately ; the latter perhaps 
because of familiarity with similar teats gained in Psychology I. 
The bulk of each senior class ranks in the highest quartile of the 
freshman class subjected to the same edition of the test. This is, 
of course, as it should be, through the natural process ot*selection 
and elimination of the weaker operating over three college years. 
There remain, to be sure, in the senior classes a number of strag- 
g'.era in the lower quartiles whose academic status is for the most 
part as unsatisfactory as their intelligence rating. 

In order to check the operation of selection versus training more 
exactly, in January, 1923, when the freshmen tested in 1919 were 
seniors, the number of survivors in each of the original quartiles 
was tabulated (see Table III). The percentage of the survivors 
ranking above the median was found to be only 61 per cent, a 
figure somewhat below that for senior-freshman comparisons when 
two classes are tested simultaneously, the former in their senior 
year (84%). The 25, 60, 75, 100 percentiles for 1923 seniors were 
also found to average only about 6 points higher than those for 
the same group as freshmen, although the discrepancy between 
senior and freshman medians for 1922 and 1925 (tested simul- 
taneously) was 18 points. Granted that the quality of entrant 
has not deteriorated from 1917-1921, individual improvement would 
seem to play a more important role than selection in raising senior 
scores.' Even so, the rise to be credited to senior superiority in 
training — in knowledge, aplomb, concentration, grasp, or what not 
—say 10 or 12 points on the average, forms only a fraction of the 
total range of difference in abilities in the original gropp (90 to 
100 points). In other words, three years' college trwtung woi^d 
avail, presumably, tf shift the rank of a given individual hardly 
a couple of deciles — a concluaion borne out by the records of re- 
testing in the sophomore year, where the average gain approxi- 
mates a decile. 

'Thi! fact Chat scorea vary on the aTenn Inveraelr with tha ace «C tbe 
subject, from 16 to 21, mlslit aLHD be cited as evidence cbat tbe t«*t meas- 
area, not amouot ot training, but native abUlly. 

■Alcbougb, twfare proceedtiiK to way aach coDclualan. the ofiDaiMl loiMa In 
Ibi: upper te»l and grade decilea of 1923— largelj through tranater to btbci 
InalltalloaB—flhodld be drawn Into the cnlcnlatton. ' • ' 
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RATING OF SENIOKS WITRIN TBE FRESHMAN QUASTIL'S. DISTRIBUTION 

1921 1922 1921 1922 1923 

Fcr Problenia Ccnect Per Adjusted S:::r2 Cjrrect. Adj. Siore 
Qoartile* Freqneocy 



I 3 .... 3 1 



Total 29 32 29 32 34 

Above median, 24 30 or 25 or 27 or 23 or 21 or 

or 83 pr ct. 93 pr ct. 86 pr ct 84 pr ct. 66 pr ct. 61 pr ct. 

*Quartile rank in terms of 1924 freshman records for 1921, seniors 
in terms of 1923 freshman records for 1922, aeniorB 
in terms of 1923 freshman records for 1923, seniors 

LATIN ENTRANCE CREDITS AND INTELLIGENCE BATING. 

In order to estimate the possible detriment to the student body 
of altering the conventional Latin entrance requirement of the 
eastern colleges, both intelli^nce rating and academic standing 
for the freshman and sophomore years of students whose entrance 
certificates showed respectively 4, 3, 2, 1, or Latin credits were 
tabulated. As shown in Table V, the median intelligence rating 
of those offering the standard number of units (4> is onJy slightly 
above the rating for those offering fewer. Furtlier, the individnala 
of the two groups are similarly distributed over the ten test 
deciles, and the ratio of students above and below the median is 
practically the same (1 to 1) in each division. Adhering to the 
old 4-point Latin requirement would have cost the college 6 out 
of 16 of the most promising members of 1923; 4 out of 11 of 1924; 
and 2 out of 12 from 1925. If the intelligence test is a reliable 
indicator, the 4 unit Latin requirement is no longer the sieve for 
elinainating the weaker students which it seemed to be ten or 
fifteen years ago, when the brighter minds in the secondary schools 
were tirged to complete the four years of Latin in the classical 
course, and failure to do so was a fair indication of either sloth 
or stupidity. This requirement now cuts out the sheep along with 
the goats. 

From the point of view of academic success, at least in the 
BOphoinoTe and freshman years, the comparison of the reduced 
credit with the standard group is less favorable. The median 
frade for the former is somewhat lower, the number of students 
above the class average proportionately smaller. ' At the same 
time, the students of this group range through all the deciles of 
4[rade rank, and their elimination through a 4-point entrance re- 
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quirement would have cost the class of 1923 6 out of its best 13 
students; 1924, 1 out of 13; 1926, 3 out of 11. 

Assignment of the reasons for the elightly lower academic 
achievement of the Sweet Briar student with reduced Latin en- 
trance would be impossible without a fuller analysis of the con- 
ditions governing admission than is here practicable. There is, 
however, no real evidence that it indicates that the lack of Latin 
handicaps the student in either linguistic or scientitic studies.' It 
may indeed signify that the steadfast pursuit of Latin studies Js 
still in a degree a measure of the scholastic ambition and energy 
of the special group of students who apply to Sweet Briar for 
admission. This latter view would, in fact, seem to he supported 
by the falling away of 3-0 point Latin entrants in the sophomore 
year, as compared with 4 point — see Table V, in which the ratio 
of the former to the latter drops from roughly 1-1 to 1-2 for 1923, 
from 3-5 to 1-2 for 1924, in the sophomore years as compared with 
the freshman. This falling off is not, however, to be ascribed 
entirely to lack of scholarly ambition. The inability to obtain an 
A.B. degree on less than the full Latin entrance requirement 
operates either to discourage students from continuing in college, 
or ta encourage their transfer to other institutions, e.g., state 
universities, where the lack of Latin is not a handicap. The effort 
TABLE V 

LATIN ENTRANCE CREDITS AND INTELLIGENCE RATING 
FREQUENCY OF CREDIT GROUPS 

Class No. 4 3 2 1 Tot. 0-3 Credits Year 

Fre8h-1923 149 79 18 32 5 15 70 

man 1924 116 71 14 24 7 45 

1926 116 73 17 22 4 43 
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27 



Sopho- 



1»23 
1924 
1925 



1923 
1924 
1925 



Median Grade Deciles 
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to make up the missinf; Latin credits in college in order to enter 
for the A.B. degree while carrying full freshman work also oper- 
ates to lower their academic status. In any case, it is obvious that 
the effect upon the intelligence level of the student body of l;wer- 
ing the Latin requirement has not been at all as dolorous as the 
Latin enthusiasts were wont to predict. 
TABLE VL 

CORRELATION OP TESTS AND GRADES 

Soph, and Jun., 

Fresh- Fresh- Soph, and Jun. and Four 

Year n'.an No. man No. Fresh. No. Senior Years 

1923 .43 146 .431,6 78 .517 38 

1924 .42 112 .48 65 

1925 .44 113 

1921 .34 21 .39 .48"^ .48 

PREDICTIVE VALUE OF THE TEST 
Throughout the above discussion, the value of the Thurstone 
te^t as an indicator of ability has been more or less assumed. It 
remains to examine its claim more minutely, to determine the exact 
degree of reliability of the test in relation to success or failure 
at Sweet Briar College. With this object in view, the test scores 
have been correlated with instructors' estimates,' and with academic 
grades for from 1 to 3 years. The test ratings of students drop- 
ping out and remaining in each class have been compared. A 
number of members of 1923 and 1924 have been re-examined with 
an alternative form of the test. Cases of marked discrepancy be- 
tween scores and academic ranks have been carefully analysed, and 
the health records of each class scrutinized for whatever light 
they may throw upon the problem. 
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Teat Scores and Grade Rank. After trying out and discarding 
various methods of weighting, the following procedure was 
adopted. The letter grades ot each student for the year were 
converted into numbers (following the scheme A^ll, A— 1=10, 
B+^— 9, etc.) and the total obtained. This total instead of the 
usual average was then made the basis of a grade ranking, and 
correlation coefficients with test rating (based upon adjusted 
score) obtained. These coefficients (R, calculated by the Spear- 
man foot-rule, X1.5) are shown in Table VL The figure for the 
first year grades is about the same for all classes, +.43, and ap- 
proximates that usually quoted for freshman groups of fairly 
homogeneous material.' When sophomore and junior grades are 
added, this figure ri^es to .517 for the 38 surviving members of 
1923. 

A clearer notion of the degree of correspondence (or divergence) 
between test and grade rankings may be obtained by dividing each 
class into four sections or quartiles, first on the basis of their test 
ratings, second, upon that of their year's grades. The number of 
students occupying a similar quartile in each set of measures may 
then be computed, also the number occupying the highest quartile 
in one and the lowest in the other, i. c, the number both of 
coincidences and of absolute disagreements in rank. E. g., as 
shown in Table VII, 22 individuals out of the 35 in the highest 
test quartile for 1923 rank also highest in freshma nscholarship; 
14 out of 28 for 1324; 15 out of 28 for 1925. At the same time 
the range of academic achievement for any given degree of test 
performance is wide, and a few individuals from the lowest test 
quartile in each class attain the highest grade quartile, at least 
in their freshman year. The percentage of the group maintaining 
the same quartile rank in both sets of measures is 43 for 1923, 
42 for 1924, 39 for 1925.' This means that we would be absolutely 
right in the case of about 4 out of 10 students in predicting their 
quartile rank in scholarship on the basis of their quartile position 
in test rating; absolutely wrong in the case of only 3 or 4 out 
of 100 (these latter discrepancies being reduced or eliminated 
when the ranking is based upon the grades of latter years.) 
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TABLE Vn. 

QuARTiLG Coincidence In Test And Grade Bankings 

A. 1923 FRESHMAN GRADES 



I 



11 



15 



No. SubjecU 35 37 3G 37 

Total lU 

Coincidence 62(43%) 

DiaaKreement 4(2.7%> 

B. 1923 JUNIOR, SOPHOMORE AND FRESHMAN GRADES 
IV III II I Total 



TESTS 



IV 
III 



1 



10 
13 



Total 
Coincidence 
Disagreement 



C. 1924 FRESHMAN GRADES 



I 



No. Subjects 

Total 
Coincidence 
Disa^eement 



D. 1925 FRESHMAN GRADES 



47(42%) 
3(2.6%) 



I 



No. Subjects 

Total 
Coincidence 
Disagreement 



44(39%) 
6(6%) 



FRESHMAN TESTS IN THE SMALL COLLEGE 
E. 1921 FOUR YEARS GRADES 



Total 21 

Coincidence 12(57%) 

Disagreement 2(9.5%) 

For the test ranking of those delinquent in studies at the end 
of the freshman year, also of significance here, see Table XL For 
a corresponding proup Thurstone reports delinquents to the num- 
ber of 0, 2, 3 and 9, for the test quartiles 4 to 1. 

What is the real significance of these figures? Can a test which 
yields a correlation coefficient of less than .80, a percentage 
quartile coincidence with grades of less than 75, be of utility in 
a college office, either in the guidance or elimination of students? 
Should material or method be modified, or is the quest hopeless ? 

In answering this question, the necessity must first of all be 
emphasized of considering the grades for the entire college career 
of the student before passing judgment upon the test as prognostic 
of academic achievement. Grades, always tricky, are specially 
open to attack in the freshman year. First of all, there is the 
faUibiUly of the ivnlriictof, possibly too easily impressed by a glib 
memory, poise of manner, a fluent tongue. Second, the viiriniire iv 
ravking statidaitls in dilTerent departments, illustrated by the fact 
that the median freshman grade in the various subjects ranges 
from C minus to C plus for 1924, from C plus to B minus for 1D25 
(C=Fair. D^Conditioned. E=Good) ; while the middle point in one 
subject rose from C minus in 1920-21 to B minus in 1921-22. 
Third, owing to a certain lalifinlF of choice in mibjecfii, even in the 
freshman year, deceptively high records may be achieved by 
students doing very little real brain work; especially in the ca.se of 
courses based upon material already familiar to the well-prepared 
student. 

There is also to be considered the routine charnrler of ,i\tniy 
frenhmaii courses, involving on the whole more of a memory grind 
in Grammar, formulae, uiiil fact, than later, more advanced, and 
elective studies, which are per se better fitted to evoke real reason- 
ing ability and initiative in the Ktudont. Lastly, from the point 
of view of the individual freshman, there is the rhiiolh character 
of the first year in college, involving as it does adjustments to a 
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novel environment, collision of social and intellectual ambitions, 
as well as submission to a more or leas arbitrarily imposed curri- 
culum, in which the special bent of the individual may be ifirnored 
or thwarted. All these factors conspire to lower the value of 
freshman ^ades as prognostic of future academic success, and to 
prevent the individual student from finding her true level in the 
freshman year. An easy schedule or single-minded industry may 
run up a record unduly; the reverse factors lower it. 

Even, however, when the upper class records are at hand, the 
indications are that the correlations will hardly rise higher than 
.60 or .70. Is this to be ascribed to the shortcomings of this par- 
ticular test, or is it inevitable in all mental testing of college 
women, representing a comparatively narrow range of abilities 
and subject to certain other peculiar conditions? It is a matter 
of common knowledge that many factors apart from intelligence 
enter into the determination of academic success. Health, ambi- 
tion, habits of industry, social distraction and diversion, worry 
and other causes may tip the scales one way or the other. Is it 
not likely, particularly in the case of a group of women, working 
less under the spur of strenuous vocational motives than do men, 
that the serviceability of any mental test is necessarily limited? 

Artalusis of Cases of Marked Discrepancy between Teat Scores 
and Academic Rank. In order to apportion the blame between 
grades and tests, and determine if possible how far the test itself 
stands in need of alteration (in subject-matter, method of admin- 
istering, or scoring, duration, etc.) a number of cases of marked 
dislocation between academic rating and test scores were selected 
for further study. Twenty-three of these, along with a sprinkling 
of seven others to act as a control- — to the number of 30 in al! 
for the classes of 1923 and 1924 — were re-examined in March 
1921 with alternative forms of the test blank. Secondly, a number 
of facts were collected and tabulated (see Tables Vlii and IX) 
with regard to all freshman in whom the amount of dislocation 
is equivalent to at least t^ of the total range of rank for the 
group (representing nearly a quarter of each class.) 

A considerable amount of the divergence between the two sets 
of ratings proceeds undoubtedly from inadequacies in grade 
ratings, the shortcomings of which, especially in relation to the 
freshman curriculum, have been already commented- upon. As 
shown by the table, when sophomore grades arc substituted for 
freshman, the discrepancy with test ratings is materially re- 
duced ; as a matter of fact, in three quarters of all such cases re- 
maining in college. Cases of apparent overestimation by the test, 
rise on the average 2 deciles in grade rank; cases of underesti- 
mation drop 3 deciles. 
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Nevertheless, certain of the total number of cases in which the 
■tudent's academic record exceeds the promise of her test per- 
formance, are probably bona fide instances of wnderestimation by 
tke testa. Seven out of ten of such cases when retested rose 
several deciles in rank (although in the majority of control cases 
there was little change); and there is every reason to believe that 
the second testine: yields the truer measure of their real abilitv- 
Various familiar strictures as to the fallibility of test data seem 
to be here substantiated — notably the objection that a low score 
may be a function not of native stupidity, but of lack of training, 
of poise, self-controi or self-knowledge, manifesting itself as nerv- 
ousness, fliclitiness, poor judgment as to the b^st balance to strike 
between speed and accuracy, exag^sraled confidence or undue 
caution. Further, a scrutiny of the health records indicates that 
a certain number of the cases of discrepancy studied were laboring 
under some more or less temporary physical handicap, such as 
recovery from a recent operation, which invalidated the earlier 
testing. 

In cases of apparent overestimation by the tests, the health factor 
enters also, though in a different fashion. At least half of the 
individuals in 1924 and 1925 whose grades fall seriously below 
expectation (16 out of the 30), and practically all whose sophomore 
standing shows no improvement, have poor health records; while, 
on the other hand, the majority of cases in the class of 1925 in 
which the grade rating is surprisingly high have excellent health 
records. There is undoubtedly a quick nervous type of individual, 
capable of running up a high score in a half hour test, but lacking 
the physical stamina (and with it the ambition), for the sustained 
effort essential to a brilliant academic career. In such cases, the 
high test score may sometimes be utilized to arouse dormant ambi- 
tion, but the wisdom of so doing is often questionable; and such 
individuals are frequently outdistanced by classmates of mediocre 
ability but superior nervous and physical endurance. 

While the uncertainty and variability both of health factors and 
mental attitude complicate thus the exact prognosis of academic 
success or failure from this or any similar test, certain devices 
are available for increasing the reliability of test findings. Pains 
should be taken to stress the importance of the test results to the 
individual (without creating undue tension) ; to defer the teat 
period, in case of the physically unfit; and to repeat the test (in 
alternative form) a month or more later, at least for those occupy- 
ing the lowest test deciles. Some more exact adjustment with 
regard to the inclusion of accuracy in the test score, or the weight- 
ing of errors, is also desirable. Something might also be gained 
by the supplementary use of a will test such as Downey's or a 



MURRAY 
i;ompIete physical examination record. 
TABLE VIII. 

Discrepancies Between Test and Grade Eatings 

Class of 1923 1924 1925 



Grade Ranking* 
Number of Subjects 
Median Age 
Health Poor 

Freahman Course Easy 13 

Left Before Sophomore Year 5 
Soph. Grade Rating Nearer Test 11 
Accuracy Rating Nearer Grade 10 
No. Retested 7 

Retested Nearer Grade Decile 4 
Total 



18.3 17.8 18.4 18.3 



29 



TABLE IX. 
Results of Retesting 

Class of 1923 1924 ToUl 
No. Retested 16 14 30 

Cases Discrepancy between Test and Grade 13 10 23 
Control Cases 3 4 7 

Second Test Ranking Nearer Grade Decile 6 5 11 

Av. Decile Deviation of Freshman Grades from 

Test I Rating 4.9 4 

Av. Decile Deviation of PVeshman Grades from 

Test II Rating 3.6 3.3 

Av. Di'cile Deviation of Sophomore grades from 

Test I Rating 3.8 

Av. Decile Deviation of Sophomore grades from 

Test II Rating 2.9 

It may be added that the factor of age, or rather, that of 
youth, seems also to complicate our results in a fashion not quite 
decipherable. There is n tendency to an inverse relation between 
age and test rank, a direct one between age and grades. The 
precocious mind tests high, but a certain maturity of experience 
and pur]!oso as well as of mentality is apparently desirable ir. 
or(ier that hi;;her studies shall be assimilated in their full value, 
and sluilimn habits sot up. The weight of evidence is against 
!iiw;ring the age limit. 

Tr.'.l and G>(idr Kaiih of Withdraunh. 

AnoLhcv criterion of the academic value of test scores is some- 
times siuight in an analysis of the cases of withdrawal. For 
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Sweet Briar students, the distribution of the losses (shown in 
Table X) is fairly uniform over all the test deciles, except in the 
case of 1923, for which class, the mortality in the lowest decile is 
conspicuously greater than that in the highest. Again, the loss of 
students from the upper hal( of the test ranks is only slightly leas 
than that from the lower — roughly as 5 to 6 for 1923, and almost 
1 to 1 for the two later classes. Obviously test ranking cannot bo 
used at Sweet Briar to forecast the probability of withdrawal as 
suggested by Thurstone. That this is not, however, to be inter- 
preted as iier ae a reflection upon the reliabiUty o£ tc.;t ratings is 
indicated by thu second half of Table X: tha pi'oportion of t)ta] 
losses for the upper grade deciles practically parallels that for 
the upper test deciles — except in the case of 1926, where the record 
is as yet incomplete. 

TABLE X 
TEST AND GRADE RANK OF WITHDRAWALS 

TEST KANK* 

Year 1923 1924 1925 
(154)-" (116) (116)" 



54 
63 


25 
20 


13 

17 


38 

37 


17 
17 


117 


45 


30 


75 


34 


>M< 




lii24 
(112) 




13 
(1 



10th decile 


3 


3 


1st decile 


14 


1 


Above median 


24 


24 


Below median 


35 


20 


Total 


59 


44 



50 17 17 34 15 S 
GO 24 13 37 16 11 



109 41 30 71 



TABLE XI 

QUARTILE TEST RANKING OP DELINQUENT STUDENTS 

(Those in lowest grade decile at ena of freshman year) 

Test of 

Test Quartile 1923 1924 1925 Thurstone 

4 1110 



Total 16 11 12 14 

No. Re -registering 4 3 4 

Total number in class 149 116 116 150 

The reason for this state of affairs is not far to seek. In a 
woman's college, manifold causes other than ability and ambition 
operate to reduce the ranks of re -registrants, among them ill- 
health, poor preparation, unwillingness to conform to college 
discipline, social ambitions, family affairs and finances, desire for 
specialised courses, or a whim for transfer to other institutions. In 
a smaller college such as Sweet Briar, many freshman enter with 
the deliberate intention of remaining only a year or two, and all the 
allurements of culture do not avail to move them from this intent. 

Nevertheless, there remained in June, 1922, of the lowest test 
decile of the class of 1923, only one student; of the lowest of 1924 
three only — all struggling under heavy handicaps and in the 
lower ranks of the class. In June, 1922, moreover, the honor stu- 
dents were all, with one exception (a student whose low informa- 
tion and arithmetic scores reduced her original record, but who 
ranked considerably higher in retesting with an alternative form 
of the test) drawn from the upper quartiles, if not always the 
upper decile of their respective classes. In January, 1923, there 
remains, out of the lowest decile of the class of 1923, no student; 
of 1924, two only; of 1925, three. 

Lastly, if quartile coincidence in rank is reckoned between the 
academic ratings for the freshman and junior years of the 38 sur- 
viving members of 1923, there is found to be 37% coincidence, and 
b% total discrepancy (i. e. two students, ranking in the lowest 
quartile in their freshman year, rise to the highest in their junior). 
The percentage coincidence for junior grades and tests is 39%, 
total discrepancies lacking. 

Summing up, then, all the evidence, in face of the fact that at 
best barely a quarter of each entering class survives to graduation, 
it seems reasonable to conclude that the college would benefit 
materially by the lopping off at matriculation of the lowest test 
decile; and that the risk in so doing of losing any real college 
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ntateria) is slight. Granted the precaution of a second testing, a 
dead line for admission might be drawn not merely at the 10 but 
even at the 26 percentile — a score of about 72 correct and 73% 
accuracy (in terms of the records of 1923 at Sweet Briar, for the 
1919 edition), or better, at an adjusted score of 44, Where it Is 
not deemed feasible to risk the reduction of the freshman class in 
this fashion, it would at least be desirable to encourage by every 
means available the students of the upper quartile, to discourage 
the return at the end of the freshman year of the students of the 
lowest Judging by the correlations and other data this course 
would in the end prove more satisfactory than merely seeking the 
withdrawal of the student of the lowest grade decile or quartile 
The question of the suitability of the component elements of the 
two editions of the Thurstone test for our particular task, and the 
value of each relative to the different branches of the curriculum, 
is reserved for discussion in' another place. 



PREDICTION FORMULAE FOR TEAMS OF APTI- 
TUDE TESTS 

By Clark L. Hull 
University of Wisconsin 

I 

The rapiil advance in the practical application of tests to th« 
prediction of aptitudes, promises soon to bring into general use 
scientific prediction formulae. With the passing over of this im- 
portant branch of test technique from the theoretical to the prac- 
tical, comes a re-examination of the properties of the regression 
equal 1 11, v \v goncrJly accepted as the standard prediction form- 
ula. It is th;; chief object of the present article to point out certain 
practical difficulties associated wtih . the use of the regression 
equation for this purpose, and to propose a remedy. 

Suppose the employment department of an industry has two 
jobs for each of which a team of teats has been devised and each 
team provided with an appropriate regression equation. Let it be 
furtl.c:' supi oseti that this employment department has been in the 
habit of rating its employees on a simple uniform scale such that 
the worst man in a hundred is scored zero, and the best scored 10, 
with the mean at 5; and that the diagnostic potency of the first 
team of tests (R) is .60 while that of the second is .40. Now if 
such an employment department should begin to use its tests and 
regression equations in the prediction of aptitudes of prospective 
employees and with exactly the same grade of men as previously 
employed, it would find that the highest prdicted ssore ever ob- 
tained with the first equation would be 8, and the highest with the 
secoid only 7. In; ■.;-,-■ d of t'.c I' .n which it ;■ ■,! been occus-^mcJ. 
If the empolyment department hM\ been in the habit of discharg- 
ing all employees known to be bclnw score 2 in aptitude and had 
planned on rejecting all applicants who were ind-cated by the 
tests as probably below this levul, it would find to its surprise that 
the first equation would predict none at all below 2, and the 
second nnnt' below .'i! The equations would thus indicate no ap- 
plicants as being either very bad or very good. If the employ- 
ment department should desire to reject the lowest 25% of all 
applicants, it would hiivc to select a radically different score from 
the score marking the lowest 25^0 of its actual employees. Not 
only this but it would have to select a distinctly different score to 
accomplish this with each of the two regression equations. Or, 
to consider the matter from the point of view of the order of 
merit, a predicted score of C by the first team of tests corresponds 
ti) n rank of ti'utk from the best Jti a hundred, whereas the sn-me 
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score with the second team corresponds to a rank of third from 
the best in a hundred. 

Now the cause of all this confusion lies in the fact that regres- 
sion equations have an inevitable and usually radical tendency to 
narrow the range of distribution of predicted scores as compared 
with that of the original criterion. This is at once evident from 
an inspection of the basic regression equation,' 

x=r— y (1) 

when it is recalled that r is always less than unity. The operation 
of this tendency in the case of multiple correlation may be shown 
by means of the following miniature problem, which will also 
serve to illustrate certain other principles to be brought forward 
later. The original data of the problem are given in Table I, 
together with the results of the necessary preliminary computa- 
tions for the regression equation. 

TABLE I 
Subj. Criterion Test A Test B 

(1) (2) (3) 

I 2 8 8 

It 4 6 5 



'orrelations 


Partial S.D.'s 


ru=-(-.625 




r,F=+.5625 


S. D.,.a=2.78 


r^-|-.376 


S. D„.^1.56 




S. D.^i^^.31 


r„..=-|-.642 




ru.,=-l-.462 





V 10 11 

Mean 7 8 

S. D. 4 2 4 

Dropping the smaller decimals, the primary regression equa- 
tion on this criterion ia, 

X,— 968x.+.381x, (2) 

where the x's are the deviations of the individual subjects' scores 
from the means of the separate arrays. Substituting in this to ob- 
tain an equation in which actual test scores may be used for pur< 
poses of prediction, 

X.-7=.968(Xr-8)-|-.381(X^7) <3) 

Clearing and collecting, we obtain, 

X,=.968X,-|-.381Xr-3.41 (4) 

where the X's represent actual scores. This is the form of the^ 
regression equation ordinarily used for purposes of prediction. 

'Yule, G. U. : Introducll-m to the riicnry o/ Slalisllm, |j, 171. 
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Substituting in equation (4) the test scores of each subject 
shown in Table I, we obtain by successive application, the follow- 
ing "predictions": 

Subject Predicted 

I 7^ 

II 3^3 

III 4.13 

IV 10.64 

V 9.52 R=+.719 

Mean 7.00 

S.D. 2.877 

These predicted scores correlate with the criterion to the extent 
of 4-. 719. The mean of the predicted scores fs seen to be, as always, 
the same as that of the criterion, 7. It will be noted, however, 
that the S, D„ as would be expected from the nature of the re- 
cession equation, is much less than that of the criterion, being 
only 2.S77 as afcainst 4. This is what caused the confusion noted 
above. 

II 
As indicated by equation (1) the amount of shrinkage in the 
dispersion of the predicted scores is dependent upon the size of r. 
In cases of multiple correlation such as the present where we 
have a predicted criterion derived from a set of weighted tests, 
the shrinkage in dispersion is dependent upon the size of th cor- 
relation between the predicted and the actual criterion scores. Yule 
has designated this currelation as R'. Thus in the above example, 
if the S. D. of the criterion (which is 4) be multiplied by R (.719), 
the result will be 2.877. which is identical with the S. D, of the 
predicted scores as obtained by actual computation. Knowing this 
relation then, we may write the formula, 

Xi=cbi„iX,-f-cbi,.3Xj (5) 

where 



and all of the other symbols are the same as employed by Yule. 

This formula, while leaving the correlation between the tests and 
the criterion undisturbed, yields a prediction series with exactly the 
same mean and degree of dispersion as the criterion itself, thus 
eliminating the objectionable features of the regression equation 
noted above. It is accordingly proposed for use in vocational and 
employment prognosis. 
"^Yiiie. op. cit. p. sisi 
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In determining R. it may be recalled that it ia not necessary 
actually to make the predictions and then compute the coirelBtion 
between prediction and criterion as above, in order to find R for 
use in formula (6). R may be found very readily by formulae of 
the following type;' 

R...^VMi-r'„)(l-r'„.,) „ (6) 

SubaUtutin? appropriately in equation (6) from the values given 
in Table I, 



R,.rf=Vl-(l-.625')(l-.452') 
= .719 
This agrees exactly with the r computed from the predicted end 
the original criterion scores in the ordinary manner. 

The operation of the proposed prediction formula (6) may be 
illustrated by means of the example already considered. Substi- 
tuting the value of R in the formula for c, 
1 

.719 
=1.391 
Substituting the value of both c and b in formula (5), 
X, = 1.391 X .968 Xi + 1.391 x .381 x, 

X, = 1.345 X. + .630 X, (7) 

Equation (7) is analogous to equation (2) above. From here on, 
the procedure is exactly like that with an ordinary regression 
equation. Substituting the values of the means as in equation 
(3) and solving, we have, 

X, = 1.34B s, + .530 X. - 7.468 (8) 

Substituting the test scores of the various subjects in (8) as was 
done in (4), the following predictions are obtained: 
Predicted 
Subject Score 

I 7.629 

II 1.844 

III 3.007 

IV 12.051 R= .719 
V 10.506 

Mean 6.987 (7, 

S. D. 3.995 (4) 

It will be observed that in this prediction, not only the mean is 
the same as that of the original criterion, but that the standard 
deviation is also the same. The shrinkage in the dispersion of 
the predicted scores caused by the regression equation has been 
corrected by the prediction formula (6), and the standard devia- 

■Yule. op. cH. p. 248. 
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tion restored to its ortf^inal size of 4. The correlation is entirely 
undisturbed, standing at .719 exactly as before. 

It is to be noted that the prognosis formula employed above 
is not itself a regression equation. Tiie true multiple regression 
equation serves two distinct functions. One function is to give 
the weight that each test score should be multiplied by, that all 
combined shall yield the maximum correlation with the criterion. 
Innumerable such optimal weightings are possible, since all that 
is necessary for this is that a certain optimal proportion shall 
be maintained among the weights given to the various tests. 
The second function of the regression equation is to indicate 
the particular set of optimal weights that, when the test scores 
are multiplied by them and combined, they will yield the most 
probable abi\olufe criterion score obtainable from the data. The 
proposed formula performs the first function but not the second. 

To give the most probable absolute criterion score, the regres- 
sion equation must always reduce more or less extensively the 
dispersion of the predicted scores below that of the criterion 
aimed at. This introduces an element of uncertainty into their 
use for employment purposes, very much like what would happen 
if predictions were to be made on a new and unfamiliar scale. 
Thus with a basic 10-point scale, the maximum possible pre- 
dicted score may vary from 6 or so, up to above 9. For this rea- 
son a predicted score of 6.6, say, has little meaning when applied 
to an individual subject. It may mean that he is probably only 
slightly above the average applicant in aptitude, or it may mean 
that he is probably the one best applicant in a hundred. The 
predicted score, standing alone, gives us no light whatever as 
to which of these two extremes is more nearly approached. Un- 
fortunately this is exactly what the employer wishes to know 
from a team of tests. By restoring all predicted dispersions to 
the size of the standard criterion aimed at, the proposed formula 
eliminates this ambiguity. 

It is also easy to show that, in spite of the fact that the 
regression equation yields the most probable absolute predicted 
score, its ordinary use in employment may lead to unfortunate 
results. Let us revert to the employment situation instanced 
above (Sec. I). Suppose the labor market to be such that it is 
necessary to hire practically all applicants, the two teams of teats 
being used merely to decide in which of the two jobs a given 
applicant probably has the greater aptitude. Let it be further 
supposed that aptitude in the two jobs is positively correlated. 
One result would be that men of fairly equal but low ability on 
both jobs would tend to score higher on the second job, since 
the low R of this team of tests tends to raise all low scores 
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towards the mean, thus tending artiEcially to shunt the poor 
workers into the second job. On the other hand, subjects having 
relatively equal but high aptitude for the two jobs will tend to 
■core lower on the second team of tests because the low R in 
this case has lowered towards the mean predictions from all high 
scores, thus tending artificially to shunt the good workmen out 
of the second job. As a result of this there will be a tendency 
for the poor workmen to be Begregat«d on the second job and 
for the better workmen to be segregated on the first job. But 
with the proposed prognosis formula, since the range of predic- 
tion would be exactly the same for both teams of tests, the un- 
fortunate tendency noted above could not take place. It would 
still be true, of course, that the predictions made from the team 
of tests with the weaker R would be less accurate than those made 
from that with the stronger R. 
Ill 

It will not infrequently happen that the original unit of meas- 
urement of a criterion will be such as would be undesirable for 
use in prediction. For example, the original criterion of the 
efflciency of lathe workers might be a set of careful micrometer 
readings showing the deviations frotP specifications of certain 
products turned out by the subjects. Obviously such a criterian, 
while probably excellent from the point of view of reliability, 
would hardly be sufficiently intelligible for general use in the 
prediction of aptitudes'. 

A special need to make predictions in terms other than those 
of the original criterion measurement will arise where it is de- 
sired to predict the aptitude of a person on a number of different 
vocations for purposes of comparison, with a view of deterrainine 
in which he is most Ukely to succeed. Such comparative predic- 
tions, it would seem, must become very general if scietitific voca- 
tional guidance is to become a reality. To be readily comparable, such 
predictions should all be made in terms of the units of some 
simple uniform scale, e. g. one of ten points. This scale will 
ordinarily not (except by chance) be the same as that of the 
original criterion measurement. For such cases the following 
method has been derived by means of which predictions may be 
mode in terms of scales having any desired means and any de- 
sired standard deviations, quite irrespective of what the corre- 

*A ralber common rorni d[ thla difflculty rfqiilrltig special treatinecC l« 
where, as bo often hoppeng, (lie only avallHl.Le crlterLon Is n sel of ranks 0[ 
tbe Bubjects in tlie uctliltv studlcci. Ranks are not only unsnlistaclory 
DDtts tor purposes of prediction, but BlBniflcnnl rfftreSHlon equations cnn- 
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Bponding values of the original criterion scales may have been. 

The procedure is first to work out the primary regresaion 
equation on the basis of the original criterion meastu-ement ex- 
actly as in <2) above. Then if we let ir, be the S. D. of the 
original criterion scores, andi^i' be the S. D. of the scores to be 
predicted on the desired scale by the prediction formula, we may 

c = — <9) 

This value of c is substituted in equation (5). Lastly the mean 
of the desired prediction series is used in place of that of the 
criterion series when the x-values are converted into X-valaes 
as in equation (3) above. 

The concrete working of the method may be illustrated by trans- 
forming equation (6) into one which will predict in terms of a 
10-potnt scale with the mean at 6 and with a S. D. of 2. Snb- 
Btitnting the appropriate values in (9). 



.719x4 
= .698 
Substituting the value of c in equation (6) and solving we have, 

X, = .6729 X, + .2649X, (10) 

Substituting in (10) the values of the means as in (3) above ex- 
cept that here B (the desired mean of the new predicted series) 
replaces the 7 of the original criterion series, we have: 

X, - 6 = .6729 (X, - 8) + .2649 (x, - 7) 
Clearing and combining, 

x. = .G729X, + .2649x. - 2.2375 (11) 

This is the formula that we have been seeking. 

Lastly by substituting the test scores of Table I in formula 
(11) we obtain the following predictions, this time in terms of the 
desired 10-point i<cale: 

"Predicted" 

Subject Score 

I 5.266 

II 2.463 

III 3.003 

, IV 7.528 r = .719 



Mean 6.000 

S. D. 2.000 

It will be observed that the prediction yielded the required meftn 
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and standard deviation, and that the correlation is still undis- 
turbed. 

The same results as secured above may be obtained quite 
simply by converting the undesirable criterion scores into the 
desired prediction scale before the zero order correlations are 
computed. This may be performed with ease and precision by a 
method described in this Journal, Vol. VI (p. 298 ff.) 

In case it should be desired to predict in terms of a scale 
different from that of the ori^nal criterion but by means of a 
true regression equation instead of the prediction forrouU rec- 
ommended above, the procedure is exactly the same as that just 
described, except that in this case. 



LAI'OR TURNOVER AND METAL ALERTNESS 
TEST SCORES 

Bv A. J. Snow 
Northwestern University 

That labor turnover is an ever present problem and s costly one 
to the industrial institutions that harbor it and to the commiinity 
generally is admitted by students. Some industrial managers ful^ 
realize the waste involved in the maintenance of an unnecessarily 
large labor turnover; if there is any one who doubts it, it is that 
group of employers who do not possess the capacity to move along 
mentally in the realm of industrial relations with the constant in- 
dustrial expansion. It is well known that this larger group, com- 
posed mainly of inefficient and dogmatic employers, is the 
greatest single obstacle in eliminating this form of social waste. 
That this group of men is always willing to assert theu tuperior 
and infallible knowledge in handling employees, is an ever present 
experience of the student in this field, and that they have almost 
completey failed in dealing with this probleni as well as with the 
other problems of industrial relations, we have proof of in the 
increasing industrial unrest. 

Labor turnover is not only an industrial problem, bat directly 
a social and community problem, this can be seen when we realize 
that waste in any form adds to the actual cost of production, which 
is paid exentually by the community of consumers. To point out 
only five of the many items which are chargeable to this form of 
preventable waste, from, the point of view of management, we have 
the following: hrst, expense incident to employing; second, instruc- 
tion to the new employee by the foreman; third, spoiled work be- 
cause of new surroundings, new tools, etc.; the same is true of the 
fourth factor, — breakage of tools and machinery; fifth, decreased 
production due to the temporary low production of new help. From 
the point of view of the ill-placed employee, we can enumerate the 
following three factors: first, loss in wages incident to the change 
of jobs; second, decrease in earnings due to the period of adapta- 
bility to the new job; third, decrease in earnings due to mis- 
placement. 

It has been known to industrial psychologists, some of the mora 
enlightened employers and a handful of economists that wages 
and working hours are not the only industrial problems; in fact, 
wages and hours, as an incentive, are subordinate, or, at most, 
on a level with the control and distribution of power within an 
industrial organization. All that one has to do to verify thia 
hypothesis is to estimate the number, magnitude and importance 
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of disputes over the distribution o£ power as compared to that 
of wages aii^ hours in any industrial court of arbitration of long 
standing, such as the industrial court in the clothing industry. 
The same may be said of our present problem — labor turnover. 
The casual observer is certain that the moat responsible factor 
for an abnormal labor turnover is the worker's dissatisfaction 
with his wage. The student of the subject knows, however, that 
dissatisfaction with wages will not alone induce the worker to 
change his job, much less to give it up with the ever-looming 
possibility of unemployment. Most human beings must feel that 
the change will be beneticial in more ways than one. As a rule 
there are a number of factors contributing to the worker's de- 
cision to leave, and some of these may very well be of the fol- 
lowing nature: abuse of power — perhaps the greatest source of 
dissatisfaction- — wages, hours, unsanitary conditions, arbitrary 
advancement policy, lack of instruction, faulty machinery or tools, 
heterogeneous "consciousness of kind" amon^ team workers, 
personal incompatibility with immediate superiors, lack of stan- 
dardized methods of process, lack of instruction, lack of spe- 
cialized training on the part of the worker, economic insecurity, 
physical incapacity, mental incapacity and a mentality too great 
for its task. 

Statistics are unfortunately lacking as regards the comparative 
importance of most of these various factors. However, some 
interesting data has recently been gathered in connection with 
the two last factors. While admitting the danger of any study 
wUch aims to dissociate any one factor from its immediate sur- 
roundings, nevertheless, such a study may be justified on the 
grounds of its illuminating results and their actual use, when 
other factors composing the complete situation are given due 
weight. Consequently, the statistical study as to the relation of 
mental alertness and labor turnover that is to follow must not 
be given undue prominence in the mind of the student of the 
general and wider problem of labor turnover. 

The Scott Company has found the following tendency in their 
practical application of psychological methods to industrial man- 
agement — that, when all of the men in any organization, excluding 
major and minor executives, are given the Scott Company Mental 
Alertness Test', the score so obtained tends on the average to 

■Most psycholonlxts recogDlzp. and rlglitly bo. a (It^clslre dilTerence be- 
tween mentiil alerlaeati and Implllgpncp, mfntHl hIltIdphu heiuK only one 
factor In tnlelligence. See, e. e., Gault. Social I-»yeliologv (Uoll, 11)23), p. TT, 
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chan^ with the worker's occupational group". This tendency 
would suggest that a worker's place in an occnpatioi which de- 
mands higher capacity for alertness than he is capable of would 
become either dissatisfied with his abnormally slow progress or 
would be discharged for incompetency. On the other hand, a 
worker of higher alertness capacity than is demanded by his 
present occupation, if not rapidly promoted into another field of 
endeavor where a higher level of alertness is necessary, will 
become dissatisfied and leave for a more promising job. The 
worker falling in this latter class is, of course, very valuable to 
an industrial enterprise and the knowledge of his capacity in 
mental alertness would tend to save him for that industry which 
gives due weight to' such information in their promotion and 
training policy. 

The following two experiments made by the Scott Company 
yield illuminating data. The first one was a study of the relation 
of the number of years each man was retarded at the time of 
leaving school — as an index of mental alertness — as related to 
the stability of the working force in several production depart- 
ments of a manufacturing company. In this study there has been 
found a striking difference between departments, e. g., in the tool 
department where the work is of a high grade and varied, "the 
greatest proportion of dissatisfaction occurs among the worhora 
who were most retarded in school. The stability increases as the 
amount of retardation lessens. . . " While in the inspection 
department of the same company, where the work is repetitive, 
monotonous and 'fool-proof "the amount of dissatisfaction is 
low for those men who were very retarded in school. The per- 
centage of dissatisfaction increases markedly until, for those 
whose progress in school was normal. . . "* 

The second study dealt with relationship of mental alertness 
test scores and labor turnover. The psychological test used was 
the Scott Company Mental Alertness Teats.' This study has been 

'All of the freohmen nf XortliweBiern L'nlveraltr bod to take the Scott 
Company Mentnl Alertnefls Teat. It him been found thnt nfter the lepae 
ot one seinester thnt all o( Che [reflbmen thnt scored In tlie upper one-tblrd la 
mental nlerlnesB tmrs 00.3 per cent eornpti a nracie. which If averaged 
throuehout their collcee career, would enalile them to graiiuate. Of (he 
frenhmen who irured In the lowent ene-thlrd In the menial alerlneBB teats, 
only 20 per cent Bccured the neceasnrv grade for Braduation. Freshmon 
whoBe hleh school acliolnrBhlp would place them In the fourth quarter, and 
who wiTi- udnilttcd to the I nlTerailj on serurlng the medium or above In 
(he mental alertness teala. only Iil.lt per rent received the grade at the end 
of the nrfll aemesler. whirh If kept up. would enable them to graduate. 
(The data for this note woH secured from Mr. Taul Lester Palmer, Norlb- 
wenlern fniviTslty.) 

•Seiitr and HnyeH 5rfrn™ and roniwton fifnae in Working wHft J/ca (Bonald 
Preaa, ID211. p. Til For n full nrroun) see alno pp. T2-2S. and (be Scott 
Company Laboratory Bulletin I.. No, a, Angusl 30, 1020. TblB bnUettn Is not 
publlBbed but mimeograplied ; ihe same is true of the bulletins referred to 

■Printed, not pnbllsbed by the Scott Company, Philadelphia, Pfl. 
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nwde upon the employees of three different companies. For the 
sake of convenience we ahsU designate the three companies as 
X, Y, and Z. The test was given to the usual routine office clerks 
of company X and Y, the only difference being that women clerks 
were the subjects in company X, while men clerks in company Y, 
In the case of company Z office boys only were examinad. In each 
cnse there has been found to exist a definite relationship between 
the mental alertness of employees, as determined by test scores, 
and labor turnover. However, this relationship is not always the 
same for the three companies. 

For company X, it has been found that about 40 per cent of 
the women clerks hired who have an alertness score between 15 
and 30 leave within six months; this percentage decreasing rapidly 
with the increase in the test scores, until the least labor turnover 
is found among clerks who scored between 35 and 50. For those 
whose scores were above 50, the percentage leaving increases rather 
rapidly until we reach those scoring highest, where the instability is 
the greatest, greater than for the clerks scoring low in the mental 
alertness.' From the above relationship of mental alertness and 
turnover we may infer that company X does not give due weight 
to the necessity of rapid promotion for its most alert clerks. 

For company Y, as in the above case of company X, the labor 
turnover is high for employees making low scores; instability rises 
with an upward trend of the alertness scores until the highest 
scores are reached, where there is found a pronounced increase 
in instability, a condition unlike that of company X. That differ- 
ence between the two companies appeared, at the time, to he due 
to a peculiar wage situation causing instability among the middle- 
high employees.* That points again to our original contention re- 
garding the cause of high labor turnover, that complete generaliza- 
tion is impossible when the phenomenon is studied in the light of 
only one isolated factor. What can be said, however, is that it is not 
true that the "make shift" or the "general run" of employees 
la responsible for the high labor turnover, but among other 
factors the incompatibility of the requirements of the job with the 
capacity for mental alertness as manifested by the worker, is an 
important contributing cause — and perhaps, at Umeg, the only 
cause for labor turnover. That becomes of further significance 
with the multiplication of our experiments, such as the following 
one, made in company Z. 

In company Z in February, 1920, one hundred and eleven boys 
under eighteen years of age were given the mental alertness tests. 
Tbn results were filed away and no use was made of them until No- 

■ijcall CompBoy Lularatory Uiilletln L, tin. 2. March 25, :020. 
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vember, 1021, when the scores were brought out of the files and com- 
pared with the progress made by the boys during the intervening 
twenty-one months. It has been found that the average score 
for the one hundred and eleven boys was 38.7, while the score 
for the sixty-three boys, still in the company's employ, waa 41.6, 
and the average score of those no longer with the company was 
35.1, That the boys making a high score are most likely to re- 
main with the company becomes evident from the above figures; 
while the boys leaving the company's employ did so for three 
reasons: first, for better positions — their average score waa 44.7 
(notice that the score is higher than that of the boys remaining in 
the employ of the company); second, to return to school; third, 
lischarRed by the company — their average score waa 2tj.i. 

If we should oompare the salary of the boys on November 1921. 

with the alertness scores we find the following relationship: 

Number of boys. Average alertness score. Average Salary. 

10 57.3 ?16.00 

10 23.1 $13.40 

It has also been found that the average score, for the twenty- 
nine boys who were promoted to junior clerkship was 46.2, while 
the score 35.1 represents the average score of the thirty-four boys 
who have received no such promotion. 

It is not only interesting but it is of importance industrially, 
to notice that the boys who scored relatively high in the test 
either continued in the employ of company Z or left for better 
positions. Almost all promotion and, therefore, higher rate of 
pay were won by the boys taken from the same class, even though 
the alertness scores were unknown to anyone save the industrial 
relations department. 

It seems to us that, while the results from the above experiment 
are too scanty to permit any positive generalizations, nevertheless 
they are suggestive of what might be done. Consequently, we may 
venture to make the following suggestions: first, that further 
study in this field might determine the relative alertness scores 
which are most suitable for some of the industrial occupations — 
where alertness has been found to be one important factor; second, 
that knowledge so gained will be of practical importance to the 
employment manager; third, that with this knowledge in the hands 
of the employment manager, he will be able not only to reduce 
labor turnover, where previously the instability was mainly due to 
the incompatability of mental alertness with the responsiblity of 
the occupation, but, alao, he will be able to detect individuals of 
high alertness capacity whose services to the industry will be in 
their ability to learn rapidly and in that way gain quick promotion, 
ending finally with a job, the demands of which will be propor- 
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tional to the worker's ability. The third suggestion expresses an 
ideal situation which we may put in the sky, as Plato did with 
his ideal state. 



NOTES AND NEWS 
HEALTH FELLOWSHIPS AND SCHOLARSHIPS 

The American Child Health Association', believing that Itealth 
is a matter of sound education, and that no greater creed can 
be spread through the world than the gospel of good health, has 
instituted an unique series of health scholarsbipa. 

The sum of $10,000 has been allotted to these scholarships and 
fellowships, which are to be given to teachers in service who have 
been especially successful in teaching health. The money will 
be distributed in five $1,000 scholarships and fellowships, to 
college graduates now in service as principals or elementary 
school supervisors; five $500 schotarshipa to normal school gradu- 
ates or college graduates now engaged in classroom teaching; and 
fifteen $200 scholarships to holders of teacher's certificates now 
engaged in classroom teaching. 

Those sums are not hard and fast ones, the Committee announces, 
but approximate, depending upon circumstances. It also announces 
that although the conditions require the teacher to be in service 
at present, an exception to this rule may be made in favor of any 
teacher who has already done exceptional work in health educa- 
tion, even If she is not engaged in teaching at present. 

The purpose of these scholarships and fellowships is to improve 
professional training, to enable teachers to do more effective work 
in health education. 

Fellowship and scholarships shall be awarded to leaekert in 
service and to teachers not now in active service but who have had 
exceptionally successful experience in health education, who pre- 
sent evidence of some of the following qualifications: 

a. Success in teaching. 

b. Pleasing and favorable personality. 

c. Good personal health. 

d. Demonstration of unusual interest in health education. 

e. Possession of initiative, originality, leadership and organiz- 
ing ability. 

f. In addition to the above, a good scientific background is 
considered of special value, in particular, instruction in biology, 
bacteriology, chemistry, nutrition, personal hygene, public health, 
child hygiene, school hygiene, child psychology and principles of 
teaching. 

The qualifications of the Institutions in which fellowships and 
scholarships are to he placed should include the following: 

1. Recognition of standards for the promotion of the personal 
health of their own students. 
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2. A heHlthful environment in the institution for the setting np 
of desirable standards from the standpoint of sanitation, etc. 

3. A supplementary course of coordinated subjects of instruc- 
tion such as biology, nutrition, etc., in addition to the more specific 
training in health education. 

4. Opportunities for observation, preparation of programs, prac- 
tical teaching in health education. 

6. The providing of training for teachers in othe'- fields thaiv 
the field of health education. 

6. A spirit of co-operation among the various departments 
connected with health education, as evidenced by their success in 
co-ordinating the various elements contributing to health education. 

Fellowships and scholarships providing for a year's study shall 
go into effect with the beginning of the school year or in the f&ll 
of 1923. 

Summer School, Chautauqua and Travelling Scholarships will 
go into effect during the summer of 1923. 

The fundamental subject matter in any student's course should 
be derived from the following fields: Personal Hygine, Nutrition, 
Community Hygiene, Social Hygiene, Mental Hygiene, Health and 
care of infants and young children and adolescense, First aid and 
safety. Hygiene of the worker. Home nursing and care of the sick, 
School Hygiene, Psyaical Education, Principles of Health Educa- 
tion and Practice Teaching. Practice Teaching to include practice 
in all types of contact with children incident to health work in 
the school. 

For information address American Child Health Associationr 
370 7th Avenue, New York City. 

BETTER EYE SIGHT AS A NATIONAL ASSET 

The Eye Sight Conservation Council of America represents a 
distinct and organized phase of the general tendency towards 
social, economic and physical betterment. It aims to bring about 
improved vision among the masses of the nation, experience in 
education and industry having shown that a long train of illsr 
involving grave consequences, follow in the wake of defective eye 
sight. 

One of the conspicuous services performed by the Council waa 
its participation in the nationwide assay of waste conducted by 
Herbert Hoover as chairman of the Committee on Elimination of 
Waste in Industry of the Federated American Engineering So- 
cieties. This committee, whose field activities were directed by 
Mr. Wallace, found that heavy annual economic and physical losses 
were occurring in American industry through poor vision of the 
workers. All this, for the most part, was characterized as avoid- 
able waste, which the Eye Sight Conservation Council has under- 
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taken to wipe out by a thorough and systematic plan of education. 

Of the 24,000,000 school children in the United States, approxi- 
mately 10,000,000 can justly claim that their country in not giving 
them a square deal, according to Prof. Wood of Columbia. "For," 
he says, "they are laboring under a grave handicap — eye defects — 
which could be mitigated to a great extent, if not corrected en- 
tirely, by the intelligent supervision of the Elate and of the teachers 
of the nation, through proper eye tests of all pupils." Retarda- 
tion is another evil caused in part, at least, by imperfect sight. 

Experiments to determine the true economic value of perfect 
vision will be made. It is proposed to measure the improvement 
in health, increase in quality and quantity of production, advance- 
ment of individual performance, and decrease in losses due to 
waste and accident. Factory, home and school lighting, now n 
subject of Ecientitic research here and abroad, will be studied. 

The Council, through its Field Secretary, Charles F. Southard, 
is prosecuting its work in the schools of many cities. This work 
embraces lectures to parents, teachers and pupils with motion 
picture illustrations. 

Co-operation with educational authorities is the prime purpose 
of the Council. An illustration of this co-operation is found in 
New York City, where the Council participated in the observance 
of Health Day in the schools, when the eyes of more than 1,000,000 
pupils were tested. 

Wherever the Council works, it strives to establish the princi- 
ples of continued supervision of the children, mothers co-operating 
with the teachers in identifying defects, often hidden, and in 
applying corrective measures. 
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J. W. W. Wallin. Causative Factors in Mental Inferiority and 
the Prevention of Degeneracy. Miami University, 1922, 48 pp. 

The writer gives a brief account of the factors causing' mental 
inferiority. The article is a summary of his study of the personal 
and family histories of 872 clinic cases. The individuals studied 
are public school cases and not institutional or hospital cases, conse* 
quentiy the conclusions cannot be affected by hereditary cases as is 30 
truly applied to institutional cases. After a thorough discussion 
of personal and family history data and with many carefully 
worked out taUes, the author has drawn the conclusions that in- 
ebriety occurs more freauently than any other factor. He also 
makes a statement that the same thing applies to immorality. He 
summarizes other cases of mental deficiency, such as head injury, 
cerebro -spinal meningitis, infantile paralysis, epilepsy, etc., but 
finds few cases as a result of them. 

Dr. Wallin gives a valuable summary of o{>inions among experts, 
as to the degree of heredity among feeble-minded ness. His study 
shows that they are quite divergent in their beliefs. It seems 
that the "facts are not yet all in," and that the causation of 
feeble-minded ness is as complex as its conditions. It seems that 
from study (that) we cannot depend solely upon colonization^ 
sterilization and marriage laws for the reduction of feeble-minded- 
ness, but we must also prevent toxication of the parents as that 
is a big factor in injuring the young child. 

Ohio University M. La Vinia Warner. 

J. W. W. Wallin. An Investigation of the Sex Relationekip,. 
Marriage, Delinquency and Truancy of ChUdren Assigned to 
Special Public Sekool Classes. Miami University, 1922, pp. 34. 

This article is a summary of a final report "to the Board of 
Education of the St. Louis Public Schools. After seven years of 
examining children for Special Education, Dr. Wallin concludes. 
that the Board of Education would have to make provisions for 
more mentally defective boys than for mentally defective girls. 
He does not give any reasons for this. He found among the 
Special Class enrollment an average of 2,14 per cent per family and 
a per cent of 3.3 of all the children enrolled in Special Education 
to have a record of delinquency. He makes a valuable discovery 
relating to the criminality and vicousness of the feeble-minded. His 
discoveries are contrary to previous beliefs in this matter. Dr. 
Wallin suggests that the Special Class training given these children 
has corrected this anti-social conduct. The same thing is true 
of truancy. Dr. Wallin found only 4.5 per cent of the total 
enrollment of the children in Special Education to be rated 
as truants. The entire article is well-rounded argument in favor 
of Special Education. 

Dr. Wallin gives a further study of the industrial records of' 
children in Public School Special Classes for mental defectives, 
and finds that the records both industrial and criminal so far as 
they go are quite satisfactory and point to the value of Special 
Education. However, a study of tne occupations entered show 
that the Special Schools have given very littie specific training in. 
pieparation for them and the employment records of these children 
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furnish little evidence as to the type of vocdtionid training which 

should be supplied in the Special Schools. 

The remainder of the article is taken up in a discussion of the 
Legislative Act in the interest of Special Education for the State 
•of Missouri. 

Ohio University M. La Vinna Warner. 

Strong and Uhrbrock. Job A-nalyaig and The Curriculum. 
Personnel Research Series. Williams and Wilkins Company. Balti- 
more, 1923. Pp. 146. Price Sl-OO paper, $2.00 cloth. 

There is no doubt that what we need chiefly in our attempt to 
apply psychology to industrial management, is a large mass of 
ordered material collected as a result of an actual study from field 
■experiment in problems of industrial management. Be it problems 
of employment, fatigue or that of incentive, the important thing 
is not so much the ideal conditions as the creation of the possibil- 
ity for experiment and in that way learn, in the long run, what 
can be done in order to reach some workable scheme of human re- 
lations in this or that particular Industry. Such studies have 
been published by Link, Chapman, Myers Scott Company, Carregie 
institute of Technology and others — to our delight a new study of 
an important industrial problem by Strong and Uhrbrock has 
just appeared. 

Messrs. Strong and Uhrbrock set before themselves the task of 
the actual field study of the functions of the executives 
in the commercial printing industry. This survey "was 
made for the express purpose of inventorying the du- 
ties of executives and discovering where the emphasis should 
be placed in training men for similar positions" (p. 71.) "Not 
only was it worth while to secure more comprehensive information 
upon which to decide ditferences of opinion between the printing 
department faculty Carnegie Institute of Technology and printing 
exeutives, but also in order to decide differences of opinion be- 
tween the faculty in the printing department and other departments 
in the Carnegie institute" (p. 71.) To supply material from which 
a well balanced and proper curriculm could be developed and or- 
ganized the authors set before themselves the task of making a 
comprehensive study of the various executive jobs within the 
printing industry^the first task was to make a job analysis and 
from that to develop the job specification. These would naturally 
supply the information necessary for the empirical curriculm 
making. 

The present study, however, is more than an attempt to record 
the results of the above stated survey; as a matter of fact it is 
also an attempt to define the meaning of such an experimental 
attempt and to state the technique of obtaining the necessary data 
and result. Consequently we find in the book chapters dealing with 
such subjects as the following; job analysis, job specification, the 
construction of a curriculm based on job analysis, and a bibliog- 
raphy of job analysis material. 

Some "industrial psychologists" are coming to the conclusion that 
a job analysis, made for the purpose of deriving a job specifica- 
tion — to be used by the employment and training department and 
by the wage committee — should contain a study of the actual func- 
tions of a job rather than of a time and motion analysis of ttte 
worker. This latter type of job analysis has its value, but in a 
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different realm, which Ib very important — in a study of efficient 
working methods. A job analysis is perhaps not the best name 
because of ita traditional connotation to designate a study of the 
different functions performed by any given worker. Such study 
may perhaps be beat designated by the name "occupational de- 
scription." This name seems to us to be more descriptive of the 
nature and content of such s study. The authors define a job 
analysis to be "a method of scientifically dissecting a job in order 
to determine the component elements and their influence upon the 
length of learning period of the worker, production and labor 
turnover" (p. 22.) This definitian we fear is too broad: it covers 
more than the type of study made by the authors; it includes, it 
seems to us, even the most minute analysis of the worker's time 
and motion, and of the method of handling himself, tools and raw 
material. 

A job specification, the authors say, is the records of results 
obtained from the job analysis (p. 23.) "The job analysis is the 
means; the specification is the end" (p. 24.) "Today the moat sat- 
isfactory job specification is one that lists the specific duties in out- 
line form and contains a complete analysis of duties, man re- 
quirements, working conditions, essentia] education and promo- 
tional possibilities" (p. 27.) While in the actual study itself — and 
to our admiration — the authors kept clearly in mind the different 
aims of a job analysis and those of a job specification in their 
theoretical statements, as above quoted, we must confess the dif- 
ference ia not clearly stated, if not really confused; for example, 
the statement that a "satisfactory job specification is one that 
lists the specific duties in outline form and contains a complete 
analysis of duties. "Is that not a part of job analysis or are the 
nature and content of a Job analysis and of a job specification 
the same? Or is the difierence only that of function? 

The content of the book is a valuable contribution to the much 
needed experimental work in personnel problems. Not only the 
authors and the psychologists in the Carnegie Institute of Tech- 
nology but also the editors of the Personnel Research Series should 
be commended for the type of work that they all made possible 
to appear. It is only to be regretted that more of such studies 
have not appeared up-to-date but we look with confidence to the 

Northwestern University A, J. Snow. 

Edwin A. Shaw and Edward A. Lincoln. A Comparison of 
the Intelligence and Training of School Children in a Massachu- 
setts Town. Harvard Monographs in Education, Number 1. Cam- 
bridge, Mass. The Graduate School of Education, Harvard Uni- 
versity. 1922. 

We have in this monograph a report of two surveys of the 
schools of a small town. Group tests of intelligence and edu- 
cational teats in arithmetic, writing and reading were given in 1921 
and again one year later. The study emphasizes the importance 
of the interpretation of survey results by the teachers and officers 
themselves. It is upon them then that the duty of providing 
remedial measures rests. The reports which are not effective in 
practice in the systems where the data are gathered fail of their 
main purpose. The authors also caution against over-emphasis of 
Uhe formal processes which standard tests now measure; and the 
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opinion is expressed that most standards are too high for practical 
purposes thus causing a sacrilice of the leaa easily measurable to 
the more easily measurable results. 

Walter F. Dearborn, Edward A. Lincoln and Edwin A. Shaw. 
Standard Educational Tests in the Elementary Traimng Sehoola 
of Missouri. Harvard Monographs in Education, Number 3. Cam- 
bridge, Mass. The Graduate School of Education, Harvard Uni- 
versity. 1922. 

This monograph gives the detailed results, with some comment 
thereon, of the educational tests which were given in the investi- 
gation of teacher-training in Missouri. A general summary of the 
results has already been published in "The Professional Prepar- 
ation of Teachers for American Schools" issued fay the Carnegie 
Foundation. It seems strange that in this university monograph 
the name "Cape Girardeau" should be almost consistently mis- 
spelled. 

Ohio University H. G. GOOD. 

A. B. FiTT. The Human Instincts in Business. The Lothian 
Book Publishing Company, Melbourne and Sydney, 1922, Pp. Vllt 
and 100. 

The author of this book does not claim to have made any new 
contribution to our knowledge of instincts; he has attempted only 
to point out in what way our knowledge of human nature — in the 
major part our knowledge of instincts — can be of value in solving 
the problem of industrial relations, and that seems to be mainly a 
problem of incentives. The "book is an outline of some of the 
main features of a series of lectures delivered in 1916 to a body 
of men and women representative of the Melbourne business 
world" (p. VIII). 

Professor Fitt in his attempt to throw some light upon the diffi- 
cult industrial problem shows a pretty thoroughgoing influence of 
Professor McDou gal— while his application of Professor Mc- 
Dougal's general theory of instinct is clear it lacks the brilliancy 
of Professor Watts' treatment in his Introduction to the Psytho- 
togical Problems of Induittry. One is familiar with such an at- 
tempt i. e., as started in the United States by Professor Parker 
and followed with last mastery by Mr. Tead ; in England by Pro- 
fessor Watts. Neither Mr. Tead's nor Professor Fitt's books are 
of great value as proposed solutions of the problem of economic 
motives— their worth lies in a different direction, Mr, Tead's 
vivid examples of industrial maladjustment are useful as a source 
of cases; while Professor Fitt's application of instincts to the gen- 
eral problem of economic motives is suggestive. Both, however, 
suffer because of a lack of method of approach to the problem. It 
seems to us that the only method is an empirical one and no other. 
The tendency today is to base too many deductions and generalisa- 
tions of wide economic application on our hypothetical knowledge 
of instincts. It is a pity that we should spend so much of our 
enerey in rationalization. If we had knowledge of social behavior 
which was derived from experimentation or observation of a very 
large number of social phenomena then with caution we mifrht 
apply such knowledge to our general problem of economic motives, 
but as the case is our present social psychology is the most hypo- 
thetical branch of the science and therefore such a procedure, is at 
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laly — dangerous. 

„ . , _„. number of cases 

and from these, if possible, infer certain hypothesis, and further 
by 'their appH cation — social and economic experiments — come 
closer to a true knowledge of these complex human motives. If not, 
the result of such a set of lectures as these by Professor Fitt will 
produce comments such as the one stated in the introduction by the 
sponsor of the series; "while the hearer could not say that he had 

Gained anything that he could directly apply in his business, he 
ound that his point of view had been changed" (p, VII). 

Just as Mr. Tead'a Instineta in Industry so Professor Fitt's hook 
The Human Instincts in Business suggests — even though uncon- 
sciously, I presume, because such a point of view is impossible — 
that instincts as motives operate one at a time or if in groups as 
independent units and naturally we find the customary list of 
chapters, of which the following are some examples: "The Gre- 
garious Instinct," "Suggestion and Imitation," "Self-display, Pug- 
nacity, Contra-su^gestion, Emulation," "The Collecting, Acquiring, 
or Hoarding Instinct," "The Instinct of Self-abasement in Relation 
to Self-assertion." The following will serve as a specific illustra- 
tion of the author's application of the supposed knowledge of in- 
stincts to a particular problem of industrial management; "Pay- 
ment by piece rate la the method employed in very many factories 
(in some countries industrial legislation will not allow it), and 
there can be no doubt that it gives the most direct approach to the 
original nature of the instinct. For each separate stroke or effort, 
for each unit of work completed, there is a separate unit in pay- 
ment. The reward stands in direct proportion to the work done. 
The various other methods of task-payment increase the pay with 
increases in the amount of work done, but the increase is not di- 
rectly proportional. Still the appeal is greater than that of the 
fixed wage, which does not present the continual draw or stimulus 
to effort/' 

"Again, once the rhythmic activity from effort to reward, re- 
ward to further effort is set up, it can be kept going to almost any 
extent, just as the squirrel or hamster adds to its store long after 
the winter's needs have been satisfied. Thus, subject to the limits 
of human capacity, the appeal to effort of the task-payment sys- 
tems never ceases" (pp. 64-65). Here the author forgets the great 
dangers of a "piece rate system" upon the general health and effi- 
ciency of the worker; the nervous strain upon the slower employee 
and, what is more, the actual experimental proof that the use of 
wages as an incentive is rather limited. 

It is interesting to note, however, that the British psychologists 
more than the American — in the United States, however, a group 
of brilliant younger economists — have attempted to throw some 
light upon the much vexed problem of economic incentive — a prob- 
lem so disturbing to all students of industrial personnel. 

Northwestern University. A. J. Snow. 

Univeraily of Iowa Studies in Psychology, No. VIII, Edited by 
Carl E. Seashore. Psychological Review Co., Princeton, N. J., 
1922. Pp. IV, 382. Price (7) 

This collection of monographs represents a somewhat extended 
series of studies in sound localization, the psychology of music, 
and muscular reaction. It will be impossible to review all the 17 
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articles in any thoroughgoing way because of their variability of 
subject matter, and variety of technique, since nine of the articles 
are doctors' theses. 

The first three articles by Seashore, Halverson, and Stewart, 
respectively, deal with the wave-phase localization of sounds. Sea- 
shore sketches the progresa made in the subject previous to the 
World War; Halverson presents a mass of observed data on the 
subject, but sets forth no conclusions; while Stewart, approachinff 
the problem from the standpoint of physics, reaches the conclusion 
that the phase effect is not wholly due to varying intensity-ratios 
but that the organs of hearing respond to the phase as such. 

The next eight articles deal with the psychology of music. These 
are more or less condensed doctors' theses. Bunch investigated 
the acuity of hearing throughout the tonal range. He reviews the 
previous work done in this field, describes the Iowa Pitch Ran^ 
Audiometer which he perfected, and presents data to show wherein 
his instrument permits a much more effective means of detecting 
various types of defects of the internal car than any instruments 
in previous use. Zuehl's thesis describes a still further develop- 
ment of the instrument described by Bunch. He also establishes 
norms of auditory acuity based upon ages of 6 to 15, 17 to 41, and 
42 to 73 years, in which some very interesting facts with regard 
to pitch acuity for high tones is shown. Zuehl presents & very 
brief article describing a stroboscopic device for measuring revo- 
lution rates. As a piece of laboratory equipment this apparatus 
meets a difficult situation at reasonable cost. Knock has investi- 
gated a means of training the voice by the aid of the eye. His 
measurements are made with the tonoscope. the standard 266 fork, 
and the Koenig resonator. His subjects sang a standard tone, its 
major third, its fifth, and the octave. His results agree with pre- 
vious work in that the major third, the Afth, and the octave are 
found to be of about equal difficulty in singing. Errors in singing 
tend to a daily similarity. It is found that one can judge the pitch 
and inaccuracies of another voice better than of his own. Gaw 
applies the principle of vocational guidance to schools of music. 
Her data collected from students in music at Northwestern Univer- 
sity shows clearly by graphic representation of individual char- 
acteristics that musical surveys, thoroughly made, are of great 
value in advising students who desire a musical education. Stan- 
ton's study of inheritance of specific musical capacities presents 
family histories, and a series of musical talent pedigree charts 
which lead her to the conclusion that musical talent is probably 
inherited according to Mendelian laws. Merry's article describes 
a method of graphically recording all the speech inflections of the 
human voice. A detailed description of the apparatus, including 
an illustration, is given alongside sample charts and graphs. 
Schoen's article is a study of the unconscious modifications of the 
singer's voice while attempting to sing a musical melody. Especial 
attention is given the vibrato. He concludes that tones are usually 
attacked at a pitch lower than intended when preceded by a lower 
tone, and that they are released at a pitch higher than intended; 
that tones are rarely sustained their full interval ; that two tones 
are seldom sung alike even by the same individual that certain 
vowels are inherently higher than others; and that the emotion 
expressed by the vibrato is made possible because we have so fre- 
quently associated tremor with emotion in past experience. Wick- 
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ham'a article is only a preliminary study in the control of intensity 
of sounds by touch. Agnew presents two articles in which she 
attempts to compare the auditory imagery of musicians, psychol- 
o^sts, and children. She uses the questionnaire method and finds 
that musicians generally attribute themselves with an auditory 
imagery which develops with training ; Psychologists are more crit- 
ical and believe that their musical images are more kinaesthetic 
than auditory; and children and untrained adults allege a very 
decided auditory imagery of sounds. Her study of great composers 
shows that they invariably possessed a vivid auditory imagery, but 
this was usually supported by strong imagery in other fields. 

The last three articles are studies in motor capacities. The first, 
by Miss Koerth, describes a pursuit apparatus designed to study 
eye hand coordinations. A phonograph disc, with stylus, magnets, 
counter, etc., compose the apparatus. Ream's article summarizes 
previous work with a tapping test, and describes a new technique 
for this much used experiment. Hersen's article is a study of 
serial action. His apparatus consists of a commutator attached to 
a typewriter in such a way that any one of four circuits may be 
closed. His subjects were students, army recruits, musicians, and 
stenographers. He finds a decided personal equation in speed, no 
consistent relationship between speed and accuracy, some correla- 
tion with other motor tests, and slight positive correlation with 
other motor tests, and slight positive correlation with intelligence 
tests and ability to read music at sight. 

Ohio University. C. H. Growdon. 
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EXPERIMENTS ON ROD-DIVINING 



Some months ago the pastor of a church in a neighboring town, 
a man about 70 years of age, called at thePsychological Labora- 
tory of the University of Minnesota and asked that experiments 
be conducted to measure, and if possible to explain, his apparent 
powers in locating materials by means of divining-rods. 

He gave an account covering 45 years of successful location, 
not only of water but of oil, natural gas, iron, gold and silver 
in Wisconsin, Minnesota, West Virginia and Texas, and he pre- 
sented documentary statements by engineers and others who had 
witnessed his successes, amply sufficient in amount and respecta- 
bility to warrant the belief that his powers are typical, and at 
least as great and as convincing to observers as are those of 
diviners in general. His utter sincerity was manifest not only 
by his profession and by his action in seeking scientific test and 
explanation, but also through the fact that he agreed without 
reserve that the time and all other conditions of experimentation 
should be determined by us, and that publication should be allowed, 
whatever the favorable or unfavorable outcome of results. Further 
evidence appears in the account below. 

The experiments were conducted in and about the Psycho- 
logical Laboratory during the morning and afternoon of March 
26, 1923. The writer was assisted by Professors R. M. Elliott 
and D. G. Paterson. 

TEST 1. DIVINATION OF LOCALITY 

The diviner reported previous uniform success in locating hidden 
coins and watches, and our first experiment is intended to test this 
ability. "Neutral ground" was discovered in the main laboratory 
and 8 large table moved upon it. The table top was then chalked 
in 14 squares, each 20 x 20 inches. The center of each square was 
numbered visibly, beginning with numbers 1 and 2 at the left end 
and continuing with odd numbers on one aide and even numbers on 
the other. The floor directly under the table was marked in squares 
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exactly to correspond to the top, and the floor and space beneath 
were shielded from sight by cardboard screens. 

The red used was a piece of fairly stiff piano wire bent in the 
shape of a small written "e". It was therefore smaller and more 
flexible and smooth than the Y of sapling often chosen. The "e" 
shaped loop in the wire was approximately 2 inches long and the 
ends, which were held between the fingers in a common divining 
position, were each about 5% inches in length. 

Silver coins, a silver watch and 2 gold watches were placed in 
a small cardboard box. An experimenter first placed this box upon 
the floor in the center of a square chosen by the diviner. When 
the diviner stepped upon the corresponding square of the table 
top the rod rotated definitely and strongly. When he stood in 
any other square he perceived not even a tendency to rotation. 

A random series of trials was then made. Their order was 
known only to the experimenter who did the placing. Before each 
trial this experimenter left the room. The diviner was then 
brought in by a second experimenter, mounted the table, and 
walked slowly over the squares until the rod rotated. In each 
trial he then continued exploring without indication over all the 
non-critical squares in order, and finally "double checked" his 
first location. No hesitation was manifested at any time, and 
often the diviner carried on a conversation as he explored. 

The second experimenter recorded the estimates, which always 
fell in the center of some square. Thirty-two trials were made, 
the box being placed twice in the center of each of the 14 squares, 
and at intervals (without the diviner's knowledge of such in- 
tention) 4 trials were made in which the box was not placed at 
all, but removed entirely from the room. 

In all of these four latter trials indications were obtained ex- 
actly as usual, squares 13, 3, 1 and 5 being designated. In the 
remaining twenty-eight trials the correct square was indicated 
once only, whereas two correct judgments are likely to be given 
by chance alone. 

Considering the two "sides" cf the table merely (i.e., odd num- 
bered versiia even numbered sq lares) the side was correctly in- 
dicated in 57% of trials and .he wrong side in 43%, whereas 
50% of correct judgments are most likely by chance alone. But 
if we consider the accuracy in judgments of "end" (i.e., first 7 
versus last 7 squares ; and flrst six plus square No. 8 versus 
first six plus square No. 7) the outcome is more than equally un- 
favorable; 37% right versus 63% wrong. 

A consideration of the amount of error made in location verifiea 
the judgment that successful locations were rather fewer than 
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«hance would indicate. The average error which would most 

likely occur by chance ia approximately 50 inches. The actual 
«rror3 average 54 inches. Another fair (but possibly unreliable) 
method of judg'ing accuracy is by a "paeudo-correlation" between 
the square-numbers reported and the numbers given. By rank differ- 
ences the "correlation" so obtained is -.22. A rank-differences 
correlation which considers merely the seven cross'table oblongs 
of two squares each comes out -.13. 

We must conclude that under such rigidly controlled conditions 
no power of accurate location whatever is indicated. The as- 
surance and lack of hesitation with which such faulty locations 
were made by the diviner in the apparently total absence of cues 
are truly astonishing, but our observation furnished no basis for 
«ven a guess at explanation. 

TEST 2. DIVINATION OF AMOUNT OP MATERIALS 

Neither the diviner nor any experimenter was permitted to 
know the actual results of the first test, but a second test was 
begun at once. In preliminary trials (made with knowledge on 
his part concerning the amounts of material placed in the box) 
the diviner showed that with no materials, the rod did not move; 
with only the coins, the rod moved weakly and slowly; with the 
addition of one watch it moved perceptibly more strongly and 
faster; with still another watch yet more; and with another 
watch added, very perceptibly more. He maintained his ability 
to discriminate with ease between these steps in amount of ma- 
terial present, and agreed to report accordingly in an experiment 
either "nothing," "weak," "fair," strong," or "very strong." 

The diviner stood on a square on the table top. An experi- 
menter sat beneath the table and placed in random order in the 
box in the center of the corresponding square on the floor either 
nothing or an indicated amount of material. Twenty-five trials 
were made; 6 with nothing, and 6 with each of the four positive 
amounts. 

The diviner judged correctly in 24% of cases, 20% being in- 
dicated by chance. His average error was 1.4 steps, as compared 
with the 1.6 steps which chance would indicate. The rank-dif- 
ferences correlation between actual and estimated amounts was 
-I- .20, P. E. = ±13, (Pearson coefficient = -I-.12), as compared 
with the .00 correlation most indicated by chance alone. 

It is impossible to say whether these relatively small differences 
from chance are significant or not. To avoid the fatigue of con- 
stant mounting on the table, the diviner did not leave the room 
between trials,, and the possibility exists that differences in the 
noises made in changing th6 amounts, in placing the box again on 



the floor, in the tone of the experimenter's voice in calling "ready", 
etc., may have served quite "unintentionally" or "unconsciously" 
as cues which slightly favored correct judgments. 

TEST 3. DIVINATION OP DEPTH 
As an indicator of depth, the diviner used a heavy straight 
wire rod about 20 inches long, fitted with a handle and weighted 
at the outer end. This rod vibrates vertically a given number of 
times until it corresponds to the supposed depth of the material 
in feet below the diviner's ground. The plane of vibration then 
suddenly shifts to horizontal. 

"Neutral ground" was located in the hallway on the second 
floor of the laboratory. In the lower hall directly beneath, a 
long step-ladder reaching from floor to ceiling was set up at an 
angle of approximately 70 degrees. The depths chosen for experi- 
ment were the 12 steps of this ladder and a point on the floor at 
its foot. According to measurements taken after the completion 
of the experiment the rise per step was approximately 11 inches, 
and the range of the thirteen depths chosen varied between ap- 
proximately 1.1 and 11.9 feet. 

The experimenter placed the box of materials used in teat 1 at 
various depths in a random order known only to himself. He 
was never visible to the diviner, but noises made in climbing up 
and down and in placing the box were faintly audible via the 
stairways to any one in the second floor hallway where the diviner 
stood. The possibility of such auditory cues might have been 
avoided by leading the diviner from the hall between trials but 
time did not permit. The diviner and the second experimenter, who 
stood by him and recorded his estimates, knew nothing of the 
actual depth- positions used save that they varied by steps be- 
tween the two floors. 

Twenty-six trials were taken in random order, each of the 18 
depth positions being twice used. In each trial the diviner used 
first the location rod and then the depth-rod described above. H« 
then gave verbal reports. Estimates such as "between 7 and 8 
feet" were recorded as 7U feet. 

The estimates ranged between 3 and 16.5 feet. Seventy^seven 
per cent of trials were over-estimations, the average estimate 
being 9.5, as compared with a true average of 6.6 feet. The 
average error of estimate was 4.G feet (in a range of about 11 
feet) and only 12% of the Judgments were accurate within 1 ft. 
The rank-difFerences correlation between the actual depths and 
the diviner's estimates was +.29, (P. E. = .11) which even la so 
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TEST 4. DIVINATION OF DEPTH WITH INTENTIONAL 
SUGGESTION 

About two-thirds of the way up the stairways leading from the 
first to the second floor hallway mentioned in test 3 are two land- 
ingB, from which both the step-ladder and the diviner could be 
seen. In test 4, taken in the afternoon, six spectators were allowed 
to stand and watch both the placing and the divining. In order 
clearly to see the experimenter place the box on the upper step* 
of the ladder, spectators naturally lean forward slightly. 

The diviner was told simply that further experiments on depth- 
estimates were desired to check those of the morning, and that 
some of our graduate students and instructors who had never seen 
divining would be interested to observe it. The spectators did 
not in general know the purpose of the experiment save that a test 
of divining was being made. They were warned not to talk loudly, 
nor by smiling when estimates were made to give possible in- 
dications of accuracy or inaccuracy. After half of the trials were 
made the spectators were told privately to try to make their ob- 
servation of the experimenter's "placings" somewhat less visibly 
evident by avoiding leaning to see the upper steps of the ladder. 
All watched with some interest a series of 2G trials, which in all 
other respects exactly duplicated those of test 3. 

The estimates ranged between 2 and 15 feet. Only 58%, 
instead of the 77% of test 3 were over -estimations. The 
average estimate was 6.9, as compared with the former average 
of 9.5, and with the true average of 6.6 feet. The average error of 
estimate was reduced from 4.5 to 2.3 feet, and the percentage of 
estimates accurate within 1 foot was raised from 12 to 19. After 
the twenty-sixth trial, 5 successive additional trials, made as if in 
continuation of the series, but with the box of materials entirely 
removed from the hall, resulted in estimates of 2, 14, 3, 1% and 
3 feet. 

The fact that after test 3 the diviner had seen the experi- 
menter measure with a yard-stick the total height from floor to 
floor may partially account for the improvement in the range of 
his estimates, and for some of the decrease in amount of over- 
estimation and of errors, though there is no evidence to show that 
such correction was realized or knowingly made. Such knowledge 
of absolute distance, however, would not by itself tend to raise 
a rank-differences correlation above that obtained in test 3, since 
relative rank-order (and not absolute accuracy) is here the deter- 
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tniningr factor. The correlation, however, was actually raised from 
+.29 to +.77, and this notable improvement in accuracy of r^ 
lative depth accordingly appears to be due to caes obtained from 
the spectator's behavior (unconscious and involuntary movements). 

Spectators agree that external observation of the diviner's be> 
havior did not at all indicate that he gave any particular or 
intentional attention to them or their actions. When not con- 
versing he appeared simply to be "entrancedly" attentive to the 
action of the rod. He himself, with every objective indication ol 
sincerity, maintains that the rod simply "acts of itself", inde- 
pendently of or "almost in spite of" his volition, and he has no 
theory to account for his apparent and real successes under less 
strictly controlled conditions in the field. 

He was entirely surprised when shown the results of the tests 
described, and maintains that his experience had led him to be- 
lieve that his estimates under our conditions would be nearly or 
quite perfect. When our theory as to cues was propounded after 
experimentation, he still could not believe that such a theory can 
be applied completely or adequately to explain his previous suc- 
eeaseSj and he made no attempt to justify or to explain the re- 
sults here presented. 

TEST 5. THE LOCATION OE WATER-MAINS 

In order more nearly to approximate field conditions, the diviner 
was asked to judge, through indications of location, direction, 
width and depth, the probable course of water-mains leading to 
two buildings on the Campus. An experimenter, who knew the 
true locations, accompanied him and recorded the observations 
on a rough map. Light snow covered the ground in most places. 

The results obtained are difficult to describe without reproducing 
the map, but our general impression is that, as is usual in such 
cases, the diviner's judgments while by no means perfectly ac- 
curate or complete, were far too accurate to attribute solely to 
chance. In case of the first building the only probable course 
indicated was near the true main, which leads 250 feet to a neigh- 
boring building, but it was distant about 15 feet at one end and 
about 50 feet at the other from the true course. The indicated 
depth of 11 feet is approximately the true depth. A second indi- 
cated course of about 100 feet at 30 feet depth was at an angle 
to a sewer-pipe leading from the rear of the building and opening 
out of sight about 50 feet down the river-bank. 

In the case of the second building an L-shaped course of 80 
feet at 10 feet depth, ending at a visible hydrant was indicated 
exactly over a true main, but a second main leading to the build- 
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ing was passed over entirely without indications. Theae out-of- 
door obaervationa appear typical and in all essential respects 
similar to numerous observations reported by Barrett' and others. 
Such experiments point to a judgment that under field conditions, 
where surface signs and cues from the accompanying person are 
possible, the diviner is usually more accurate than chance would 
indicate. 

SUMMARY 
A fair summary of the evidence regarding the accuracy and the 
explanation for the apparent sucesses of diviners is entirely im- 
possible in short space.' in j^sneral, however, the evidence appears 
to the writer to justify the following conclusions: 

1. The matter cannot be dismissed by saying that the diviner's 
successes in the field are simply lucky or chance hits, but they 
probably far exceed the expectation of chance. 

2. Diviners arc not in general chai latans, but sincere believers 
in their powers. They do not in geiieral possess accurate geo- 
logical knowledge, nor do they in general appear to rely greatly 
upon voluntary observation of contours and other surface signs, 
such as experience may have taught them might be significant. 
If such signs are important, as they appear to be in some cases, 
knowledge of their preception and importance, and knowledge of 
his own reliance upon them is not in general realized by the 
diviner. 

3. In almost all "field experiments" the diviner has been ac- 
companied by a "checker" or person who possessed knowledge of 
the true locations, depths, etc., and ones given unconsciously by 
such persons in their involuntary movements or unguarded speech 
appear to be a common basis for the diviners indications, even 
though again the diviner may not, and usually does not, 
mUntionally observe such signs or realize their importance. 

4. Experiments in which the cues mentioned in 3 and 4 above 
were rigidly excluded are rare, and their results in general are 
flither inconclusive or actually negative. The experiments in 
which predictions made by geologists and by diviners disagreed, 
and where wells were later drilled to ascertain the facts, do not 
appear crucial, and the results are variously estimated and ex- 
plained by different investigators.' Two previous experiments 
under conditions somewhat similar to our own test 1 are briefly 

'Bw F. A. Bnrrpll. /Vw. fiw. Ptiirhifal Keuaith. Vol. 13. IHOT. pp. 2-2S0. 
and Vol. m, IWHl, pp. 1.10. -IKJ. 

■A fnlrlT full l)<l>ll<>srui>hT Is givpn in Tkr Dlrlning Hot A Blllory 0/ 
Walrr-n-llehlMs, V, S. GtoI. Survey rntnplilPt 41H. 11)17. 

■Si* K. g. W. J. Hollas: Proc. 8. F. R., 2, 1894, pp. T3-78. anil W. F, Barret). 
all. tit.. Vol. IS, pp. 144-01. 



:310 FOSTER 

reported or referred to.' The results appear quite uniformljr 
negative, since the diviners obtained approximately the percentag« 
of successes which chance would indicate. Differences in humidity 
and temperature, etc. (together with hyperaestheaia) have been 
proposed as cues without, it appears, great warrant. In view 
of the facts that diviners appear more successfu! and believe 
more in their ability to locate water than metals, running rather 
than standing, and shallow rather than deep water; that plumbers 
commonly listen for leaks and that everyone has noticed the 
pccutiat' auditory quality of the moving water current, it is 
strange that one finds on casual reading no suggestion that sound 
may be an important cue in many cases. 1 am told that in some 
countries putting an ear to the ground is a recognized method of 
locating underground springs or courses. Our own experiments 
certainly point to its possible and probable significance under cer- 
tain conditions. The psychologist certainly docs not, at any rate 
until further inexplicable facts appear, need to suppose a special 
sense nor a special mystical power of "clairvoyance" or "telepathy" 
ts explain water-divining. 

5. The movements of the rod appear to the diviner to be auto- 
matic, nnd often not even to be subject to his voluntary control. 
The form of the rod nnd the mechanics of its movement are such 
as to fiivor the suggestion that it "moves of itself" and sometimes 
movts in spite of voluntary efforts genuinely made to restrain it.' 
From unbclievi^rs who inwardly vow in advance to hold the rod 
steady "though an ocean should be flowing beneath their feet," 
reports are not uncommon that they do not succeed, but that the 
rod "twists the more, the more they endeavor to restrain it." 
The various forms given to the rod, the success of some diviners 
who use no rod at all but go by "impressions" or "shiver", and the 
facts that only a relatively small percentage of persons are "sen- 
sitive", that the indications appear only If the diviner is "set" 
for them, and other facts too numerous to mention, all indicate 
that the existence of a psychical automatism and the presence 
of some suggestion to touch off a recognized response are the only 
necessary and essential bases for the "indications".* 

This hypothesis is all the more probable in the light of our 

"viT-i. K. K. I'riiw: l'.w. K P K.. -J. 1RS4, pp. TDM, aod W. F, Barrett, 
<.;., ,11.. V..I. l:i. i>, ITil: Vol. Ij. p. 3(». 

■S v. fi.r .-x<iiii].lu. mimiTHiiH iiim.mw.a irlvpn liy W. F. Itnrn-tr : op. cil., 
M. rnliitii: fi'irilualium ami tkt Kcw PHVthofoeii. lilM. pp. 31-43. 
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knowledgre vl the part played by hyperaestheaia and "unconscioug 
notice" preceding or during trance, and in hypnotic recall, the 
determination of dreams, automatic writing and the like, and in 
the light of our knowledge of the importance of cues and sug- 
gestions often given by the knower's unconscious and involuntary 
actions and accepted by the "sensitive" without clear realization 
of the fact. To become convinced in the latter regard, one has 
only to compare the conditions and results of divining with those 
of mind-reading, muscle-reading, talile-turning and of thinking 
animals like Clever Hans. 



A STUDY OF THE APPROPRIATENESS OF 
TYPE FACES 



By a. T. 
Columbia University 



In the search £or perfect advertising no factor is considered of 
too 3lig;ht importance to deserve careful investigation. The laws 
of human behavior as discovered by the psychologists have been 
generally called upon in order to draw away from an individual 
the control of his behavior and put it into the hands of the ad- 
vertiser. By far the greatest amount of consideration has been 
given to the mechanical devices for gaining and holding attention, 
and for making impressions permanent. The feelings, pleasantly 
and unpleasantly toned, are coming to be looked upon aa forces in- 
fluencing reactions to advertising sufficiently to deserve study. 
Freudian psychology, with its well-known doctrine of the suppres- 
sion of the unpleasant, may have something to do with this spread 
of interest. However, Hollingworth some years ago showed the- 
bearing of the "obliviscence of the disagreeable" upon adver- 
tising, and pointed out that advertisements to be most effective 
should be pleasantly toned. No labor or expense is spared on the 
makeup of an advertisement and especially in color and art work- 
in order to make it pleasing. Much of this elaborate use of ar- 
tistic material is sometimes criticized on the ground of lack of 
appropriateness, for after all is said, it is the appropriateness 
of the presentation that determines whether or not the total effect 
shall be pleasing. 

Typography has long been believed to be a source of mildly 
pleasant or unpleasant feeling tone, according to its character 
and appropriateness, and this belief has influenced the choice of 
type in advertising. The accompanying cut (Fig. 1) will illustrate 
the differences in the type faces used for various kinds of com- 
modities. In the case of "Disston" and "Speed-grits" the type very 
clearly carries something of the atmosphere of the commodity. 
In the case of the other names the appropriateness may not be 
so evident. The belief is fairly general that heavy faced type 
carry with them the atmosphere or feeling of solidity and strength, 
and that the thin faced type suggest fineness and delicacy. Figure 
2 shows in a striking way the type faces that are supposed to 
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carry the atmosphere of cheapness, dignity, femininity, antiquity, 
nature, and eleg'ance. 

The only published experimental study known to the authors 
of the appropriateness of type faces is that of Berliner." She 
measured, by the order of merit method, the relative suitability 
of eighteen styles of handlettered type for advertising each of 
four different commodities, namely, fish, pork and beans, pan-cake 
flour and orange marmalade. Four groups of people were used 
in the measurements. The coefiicientB of correlation among the 
groups for any one commodity will show the degree of agreement 
among the groups concerning the appropriateness of the type 
faces for that commodity. The average coefficient of correlation 
for each of the four articles is given below: 

Fish +.71 

Pork and Beans +.74 

Pancake Flour +.62 

Orange Marmalade +.60 

The author interpreted these coefficients as indicating the degree 

of definiteness of the atmosphere possessed by the commodities, 

and as the figures show, this definiteness varied somewhat with 

the commodity. 

If now the average orders obtained from any group of subjects 
for the different commodities are correlated, the size of the coeffici- 
ents will indicate the degree to which the order of the type varied 
for the dilTerent commodities or what the author called the speci- 
ficity of the atmosphere. The following figures (Table 1) were 
obtained from the judgments of a group of one hundred people: 

TABLE I 



1. Fish — 

2. Pork and Beans +.75 — 

3. Pancake Flour +.15 +.20 — 

4. Orange Marm. -.32 -.16 +.31 — 

Thus, the order for fish and orange marmalade tended to ba 
reversed, (-.32), that is, the style of type that was most appropri- 
ate for fish tended to be the least appropriate for marmalade. On 
the other hand, for fish and pork and beans the orders resembled 
each other very closely (+.75). The author concludes that com- 
modities might be grouped into classes according to the* character 
■of their atmosphere and that type might then be chosen which 

■ZtBcb. (. Ancewandtc Pirrhol.. Bd. IT. 1920. 
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would be appropriate for any member of the class. 

The experiments to be described in this report differ from those 
of Berhner in several respects, namely. 

1. Instead of hand lettering, the material consisted of twenty- 
nine of the type faces commonly used for advertising work. 

2. Appropriateness of type faces for both abstract qualities 
and for actual commodities was measured. 

3. The judgments of men and women were kept separate in 
order to show whether sex differences in this form of 
reaction were present. 

4. In only a few cases was the same person asked to judge 
more than one commodity, and then only after an interval 
long enough to minimize the effect of the memory of pre- 
vious arrangements. 

A modified form of the order of merit method was employed in 
this work on account of the large number of specimens to be 
judged. The type faces each mounted on a separate card were 
first sorted by each judge into five piles, the first pile containing 
the most appropriate and the last one containing the least appro- 
priate specimens. The order of the specimens was next determined 
within each of the five groups. Finally, the specimens in the five 
groups were put together into a single order. From forty to 
fifty judgments were obtained in this manner for each of the ten- 
categories given below; 

Cheapness Automobiles 

Dignity Building Material 

Economy Coffee 

Luxury Jewelry 

Strength Perfume 

On the following pages are given the samples of type faces used 
in the experiments with their technical names and also the final 
rank* obtained by each specimen when judged for its appropriate- 
ness for each of the categories listed above. Position I indicates 
the most appropriate specimen, and 29 the leaat. As there were^ 
twenty-nine specimens, the position of any specimen may vary 
tiom 1 to 29. The type as illustrated in this report are somewhat 
smaller than those used in the actual experiment, having been. 
reduced in order to fit the printed page. 

Tbc Bgarei represent nski obtained trom men aabjecti 0QI7. As wtll 
be demonstrated later, tbe reactions of the leiei In tbli itadr are »a. 
■ImilaT ■■ to make presentation ol botb sets of BKurei nnneceuarr- 
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An examination of the positions assigned to the specimens when 
Judged for the ten types of appropriateness shows that their re- 
lative effectiveness varies according to the purpose for which 
they are to be used. Differences in the degree of variation are 
also to be noted. For example, specimen Y' varies only from posi- 
tion 13 to position 20 in the ten categories, while Z' varies all 
the way from 1 to 29. The former type specimen would serve 
moderately well for any purpose, while the latter is either very 
apropriate or very inappropriate. The same may be said of speci- 
men Z. The range and distribution of the positions assigned to 
the type specimens may be observed readily from Table H. The 
positions from 1 to 29 are arranged in six groups, indicated 
across the top of the table. The figures in the body of the table 
indicate the number of times that a given specimen fell in a cer- 
tain group regardless of the commodity for which it was judged. 
Thus specimen A was twice given a position within the 5-9 
group, and 4 times within the 10-14 group. More detailed infor- 
mation concerning range and distribution may be obtained from 
the figures given under each of the type specimens. 

If values be assigned to the groups in Table II, so that the first 
group is given a value of 1, the second group is given a value 
of 2, etc., the total value assigned to each type face may be 
roughly determined. Such total values would indicate which 
type, if any, tended to be consistently appropriate or inappropri- 
ate wherever used. These values are given in Table III. No one 
of the specimens stands out as generally best or generally poorest. 
Specimen B appears to be the most effective for all purposes and 
specimen J the least effective. But the differences are slight. 

TABLE III 



F 38 L 35 R 35 X 33 

The relation among the orders for the different categories may 
be expressed in terms of coefficients of correlation, -the higher 
the positive correlation the greater the similarity among the 
orders for the different categories. The coefficients obtained by 
the Rank Difference Method are given in Table IV for the men and 
in Table V for the women. 

In interpreting these figures it should be remembered that the 
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groups of persons judging were not the same for any two categor- 
ies and that rarely was the same judge used twice. Thus, the high 
negative correlation' between the orders for Cheapness and Digni- 
ty (-.34) or between Cheapness and Luxury (-.94) repre- 
sents a real difference in efFectiveness and not merely a tendency 
on the part of the judges to be logical, in placing a given specimen 
high for one quality and low for some contrasting quality. The 
coefficients for Cheapness and Economy (+.47) and for Dignity 
and Luxury (+.96) are high and positive. Strength correlates 
positively with Cheapness (+.62) and with Economy (+.31) 
while it correlates negatively with Luxury (-.96) and with Dig- 
nity (-.89). Plain heavy type, while indicating strength, also 
suggest cheapness and economy as compared with the more deli- 
cate and ornate type forms. 

A coefficient of correlation of +.94 between the orders for 
Jewelry and Perfume indicates that the type faces that are 
most appropriate for the one are also most appropriate for the 
other. These two commodities correlate with the orders for 
Automobiles and Building Material -.95 and -.92 respectively, 
showing that the type forms most effective for the one group 
are the least effective for the other group. 

The order for Coffee, while quite similar to that for Building 
Material (+.90) and for Automobiles (+.81) is quite different 
from that for Jewelry (-.91) and Perfume (-.96). 

Interesting comparisons may be made between the abstract 
group (Dignity, Economy, etc.) and the commodity group (Auto- 
mobiles, Building Material, etc.) Cheapness correlates positively 
and high with Coffee (+.90) and negatively and high with 
Jewelry (-.94,), and Perfume (-.88). Dignity correlat«s high 
and positive with Jewelry (+.89) and with Perfume (+.80). 
The orders for Economy and Automobiles show a correlation of 
+ .28, Economy and Building Material +.40, and Economy with 
Coffee +.38. There is a negative relationship between the orders 
for Economy and Jewelry (-.38) and Economy and Perfume 
(-.29). The coefficients in which Economy is concerned are the 
lowest to be found in the table. Luxury correlates high and 
positively with Jewelry (+.93) and Perfume (+.88) and neg- 
atively with the other commodities. Strength correlates high 
and positively with Automobiles (+.73), Building Material (+.93) 
and Coffee (+.91), but negatively and high with Jewelry (-1.00) 
and Perfume (-1.00). 

'The (ulLowIng lutcrprttadons will be bused on the OnureB for men 
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Cheapness +.91 Automobiles +.81 

Dignity +.92 Building Material +.97 

Economy +.93 Coffee +.79 

Luxury +.93 Jewelry +.94 

Strength +.94 Perfume +.96 

No differences worth noting appear between the records for 
men and women. (Tables IV and V). Table VI showing the re- 
lationship between the orders for men and women contains no 
coefficient lower than +.79. This similarity of the reactions in 
the two sexes gives additional evidence of the consistency of the 
judgments of appropriateness of material of this sort. 

The results of this experiment show quite conclusively that 
differing type faces do vary in appropriateness and that judges 
are able to "feel" this appropriateness or lack or appropriateness. 
Furthermore, there is close agreement between sexes and among 
members of the same sex in the character of their reactions to 
the different type specimens. 

The experiment produces no measure of the strength of these 
"feelings". Certainly, the pleasantness or unpleasantness of the 
effects produced by these different type faces must be extremely 
mild, and it might be argued that such differences as do exist 
are too slight to warrant consideration for practical purposes. 
However, the appropriateness of type is one factor among the 
many which determine the appropriateness of the advertisement 
as a whole and therefore cannot be safely neglected. 

Some theoretical interest may attach to the question of the 
cause of the differences found in this experiment. There are two 
possible explanations. First, the type faces, by their shape, size, 
texture and the character of their lines may carry a certain at- 
mosphere about them; there may be inherent in them an atmos- 
phere of delicacy, dignity or strength. Second, the atmosphere 
which they possess may be merely a matter of use. For exampler 
we are accustomed to seeing Old English or similar type, such 
as specimens K, V, or Z' used for imposing and dignified documents 
and plain, heavy type such as specimens O and Y for simple and 
ordinary printing purposes. By the process of association the 
type may now carry the qualities transferred from the settings in 
which they have habitually appeared. 

For present practical purpose it would seem to make little 
difference which of these interpretations is correct. It is suf- 
ficient to know that type faces such as are used in current ad- 
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vertiaing practice do have characteriatic atmosphere and that 
these should be given due weight. 

One further point should be noted, namely, that the effective- 
ness of type faces such as we have used Jn this work cannot 
necessarily be predicted from the judgment of one individual, 
even though he may be an expert in typography. Only a test 
upon an adequate sampling of the population to be influenced 
will definitely determine what is the best type to use. The 
judgment of one individual may be safer where the more extreme 
forma of handlettering are under consideration, although even 
here some further check would be advisable. The effect upon a 
sampling of prospects must here, as in other cases of control of 
human behavior, be the final measure of what will or will not be 
effective. 



INTELLIGENCE TESTS VERSUS ENTRANCE 

EXAMINATIONS AS A MEANS OF PREDICTING 

SUCCESS IN COLLEGE 

By Ada Hart Arlitt and. Margaret Hall 
Bryn Mawr College 

Thia investigation begun in 1919 and completed in June, 1923 
"was undertaken to determine (1) the relative value of the record 
in intelligence teats and the record in entrance examinations as 
a means of predicting success in a college which admits only 
through the regular channels of entrance examinations, (2) the 
extent to which the record in intelligence tests could be used to 
exclude students who succeeded in passing entrance examinations 
but were not capable of doing adequate work in college, (3) the 
relative merits of two intelligence teats and entrance examination 
grades as a means of selecting the students who will do the least 
adequate work in college. 

The aubjecta, 305 in all, were students who entered Bryn Mawr 
in 1919, 1920 and 1921. The test reaults for each class were 
treated separately. As a matter of convenience the classes wiD 
hereafter be termed Group I, Group II, and Group III in the 
order of the date of entrance into college. Students who withdrew 
for any reason other than poor work before the end of Freshman 
year and students who were given only one of the two test series 
in the class to which two sets of tests were given are not included 
in thia study. 

Group I was given the Stanford Revision of the Binet Test 
used in part as a group test. Interpretation of Fables (XVI, 2), 
Memory for Paragraph <XVIII, i) and the Vocabulary Test (XVI, 
1 and XVIII, 1) were given to the group as a whole. In the first 
two of these tests the procedure followed was the same as that 
outlined by Terman except that the responses of the students were 
written in a regulation college "Blue Book". For the Vocabulary 
Teat each atudent waa given the list of one hundred words printed 
with sufficient space after each word to allow for the writing of 
a definition. Ample time waa allowed to finiah each test. The 
Vocabulary Test waa given laat and the paper handed in as soon 
as completed. All of the other tests were given individually by 
the writer. 

Group II was also given the Stanford Revision of the Binet 

The ivrlliT wLjilii'S In nckmiHledirf lier dfcy IndehiPdnesj' to MISB EdKb 
Orliidy, Si'cn'tar)' and IteKlalrnr »f tlio r»N(>SP. for her c^onstHnt co-oper. 
ntlon null ci'iirtcny tn fiirniililtiK t)ii! dutn ns lu entranoe exsmloattoD 
r(>L'iiri]i> and gradps In collugu. 
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Teat with the same procedure an that described above except 
that the Ingenuity Test (XVIII,6) was also given aa a group test.' 
As soon B3 the time allowance of Ave minutes for each section 
of this test had elapsed the students turned over a page and began 
the new problem on a new sheet. In order to avoid work on a 
problem after the time limit for that problem was up, no student 
was allowed to turn back a single sheet for any purpose. The 
Thurstone Freshman Test, Series 1920 Number IV was also 
given to this group. Group HI was given the Thurstone Fresh- 
man Test, Series 1919. 

The results of the tests of Group I in terms of I. Q. were cor- 
related with grades received in entrance e;caminationa and with 
marks at the end of the Freshman, Sophomore and Junior year& 
and at the middle of Senior year. Marks at the end of the 
Freshman and Sophomore yeat-a are in terms of the average of 
all percentage grades received by the student during the year. 
Harks in the Junior and Senior years are in terms of honor points,' 
Grades received in entrance examinations were also correlated 
with marks at the end of the Freshman, Sophomore and Junior 
years and at the middle of Senior year. The formula used was 
the Product Moment with computations from the true average: 



v.- yj-- 



The results are presented in Table I. 
TABLE I 
No. of 

students ^ P- ^- 

98 Entrance grades and marks end of Freshman year ,539 .048 
83 Entrance grades and marks end of Sophomore year .548 .052 
74 Entrance grades and marks end of Junior year .541 .055 
74 Entrance grades and marks middle of Senior year .542 ,056 
98 I. Q.'s and Entrance grades .245 .064 

98 I. Q.'s and marks end of Freshman year ,298 .062 

83 I. Q.'s and marks end of Sophomore year 
74 I. Q.'s and marks end of Junior year 
73 I. Q.'s and marks middle of Senior year 

As Will be seen from Table I, I. Q.'s show a positiv 
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correlation* with marks at the end of Freshman year and a negligi- 
tie correlation with marks at the end of Sophomore and Junior 
years. Grades received in entrance examination show a marked 
positive correlation with marks received by the end of each of the 
three college years. The coefficient of correlation for entrance 
sradea and marks received in academic work is almost twice as 
large as that for I. Q.'s and marks at the end of Freshman year 
and is more than four times as large as the coefficient of correla- 
tion for I. Q.'s and college marks at the end of Sophomore and 
Junior years and at the middle of Senior year.* 

The results obtained from correlating the two intelligence teats 
used with Group II with marks received in academic work, and 
«ntrance examination grades with college marks are presented in 
Table II. I. Q.'s show a positive but low correlation with college 
Kiarka at the end of Freshman year (.197+.064) and at the end of 
Sophomore year (.166±.07O). Thurstone Test Scores show a 
liigher correlation with college marks at the end of both years than 
do I. Q.'s. The correlation between entrance grades and college 
marks at the end of the Freshman year is .520±.04S and at the 
«nd of Sophomore year is .486±.055. 



No. of 
students 
103 Entrance grades and marks end of Freshman year 

88 Entrance grades and marks end of Sophomore year 
103 Entrance grades and I. Q. 
103 I. Q. and Freshman marks 

88 I. Q. and Sophomore marks 
103 I. Q. and Thurstone Scores 
103 Thurstone Scores and Freshman marks 

88 Thurstone Scores and Sophomore marks 

Here, as with Group I, entrance grades show a much higher 
correlation with Academic success than do the scores in either of 
the Intelligence Tests. 

The results from Group III are presented in Table III. En- 
trance grades correlate .638±.039 with marks received in the 



'Tilt 


clntHmcBiLon fiillowod here, in Kuse'f. BuKS. H, O. Statistical 


Mptliocl 


B ADplifil in Educatiim, p. 23B. (UouRhton Mifflin Co. I»1T.) 


"riie 


mnrktii decrpane In -tin; Mxe ot Ihe cn-HfflclenC beyond tbe Fresh. 




iir miiy lie piplnlupd in pnrt by llie (act that a niimlwr o( sludeuti 


low In" 


both Kradea and scorea In Intelllscnce testa withdrew at the end 


flt the 


Freshman yenr. This dOM not. Uowever, account for all of tba 







INTELLIGENCE TESTS 



TABLE III 



No. of 

students r P.E. 

104 Entrance grades and marks end of Freshman year .638 .039 

: lOd Thurstone Scores and marks end of Freshman year .347 .058 

104 Thurstone Scores and entrance grades .298 .060 

The results presented in Tables I, II and III show that of the 
three Measures on which prediction of success in the Freshman 
year in college might be based, grades in entrance examinations 
rank first, Thurstone Test scores next and I. Q.'s last. In the case 
of the last two measures the difference between the sizes of the 
-correlation coefficients in the one group to which both tests wer« 
administered in 7.7 points at the end of the Freshman year and 12.7 
points at the end of the Sophomore year. No one of the three meas- 
ures show a correlation which may be regarded as "high" accord- 
ing to Rugg's Classification except in the case of entrance grades 
and Freshman marks in Group III. 

A study was then undertaken to determine whether the records 
in intelligence tests might have been used to exclude students who, 
although able to pass the entrance examination, made unusually 
poor records in college. Each group was divided into quartiles 
according to rank in college marks. Table IV shows the distri- 
bution in quartiles according to rank in college marks of the stud- 
denta at or below the 26th percentile in entrance grades, in Thur- 
stone scores and in I. Q.'s. In the case of Groups I and II a low 
grade in entrance examinations is more indicative that the student 
will do less than average work in college than is a low score in 
intelligence tests as is shown by the fact that a larger per cent of 
the students ranking below the 26th percentile in entrance grade 
rank below the 25th percentile and median in college grade. Of the 
students ranking below the 25 percentile in I. Q. in Groups I and 
II> 47% rank below the median in college grade at the end of 
Freshman and Sophomore years. Of those ranking below the 26 
percentile in Thurstone scores 60% rank below the median in 
college grade and of those ranking below the 25 percentile in 
entrance grade 70% rank below the median in college grade. In 
Group III the intelligence test and entrance grade select the 
poorer students almost equally well, but the Thurstone test shows 
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itself to be slightly Euperior to the entrance grade. Of the studentsr 
ranking below the 25th percentile in Thurstone score 80% rank below 
median in college marks ae against 76% in the case of those rank- 
ing below the 2Bth percentile in entrance grades. 

As a final test of the selective capacity of the three measures, 
a comparison was made of the standing in college of the six. 
students ranking lowest in entrance grades, the six ranking lowest 
in I. Q., and the six ranking lowest in Thurstone scores in each 
group. This represents approximately the lowest 6% of the 
group. Of the six students ranking lowest in I. Q. in Group I 
three were below the 25th percentile of the class in college grades, 
two were between the 25th percentile and the median, none between 
the median and 75th percentile and one above the 75th percentile. 
Two of the three students below the 2Bth percentile were dropped 
at the end of Freshman year because of poor work. None of the 
six lowest in entrance grades were dropped and only one of the 
six was below the 25th percentile. 

The six students in Group II ranking lowest in Thurstone score 
were distributed as follows: one was below the 26th perecentile,. 
two were between the 26th percentile and median, two were between 
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the median and 75th percentile and one was above the T6th percen- 
tile. Of the 8i« ranking lowest in I. Q. two were dropped at the end 
of the year because of poor work, two were between the 25th per- 
centile and median and two between the median and 75th per- 
centile. Of the six ranking lowest in entrance grades two were 
below the 25th percentile, three between the 25th percentile and 
median and one between the median and 75th percentile. None of 
the six ranking lowest in entrance grades were dropped because 
of poor work. Of the six students ranking lowest in Thurstone 
score in Group III one was dropped because of poor work, and of 
(he six lowest in entrance grade one was dropped. 

Although the Thurstone Teat is, as has been shown by its corre- 
lations, a better measure on which to base prediction of success in 
college than is the I. Q. and although entrance grades is a better 
measure on which to base prediction of success in college than is 
the score in either of the intelligence tests, the 1. Q. selects the 
students who will do the poorest work in college better than does 
either the score in Thurstone Test or the grade in entrance examina- 
tions. A study, however, of the distribution by quartiles in rank in 
college grade of the six students lowest in intelligence tests will 
serve to show that to use the results of such tests to eliminate 
students who have passed the entrance examinations would be 
manifestly unfair. 

The result of our tests show three things (1) that neither the 
Thurstone Test score nor the I. Q. correlated as highly with marks 
received in college as did grades received in entrance examina- 
tions, (2) that the Intelligence Tests could not with fairness be 
used to exclude students who bad passed the entrance examina- 
tions since a large percentage of the students at or below the 
25th percentile in Intelligence Test score do adequate college work 
and less than half of the lowest Ave per cent in Intelligence 
Tests are excluded from college for poor work, (3) that the I. Q.'s 
selected the students whose work proved poorest, better than did 
the entrance examination grade or the score in the Thurstone Test, 

That our results are in no way unique can be seen from a com- 
parision of our results with those of previous investigators in 
the same field. The following table cited from Caldwell brings 
together the data from a number of sucb studies. 

The coefficient of correlation between college marks and intelli- 
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gence tests is shown in 


the column at the right 


Wissler 




.09 






Calfee 




.23 






Rowland 


and Lowden 


.37 






Waugh 




.41 






Bell 




.31 






Kitaon 




.44 






King and 


McCrory 


.39 






Caldwell 




.44 






To the above table may be added the following: 




Year 


r No. students 


Tests used 


Caldwell 


Sophomores 


.17 


24 


Stanford Revision 




Junior 


.69 


24 


Stanford Revision 


Kitson 


(Second group) .20 


40 


16 Selected Tests 


Rogers 


Seniors 


.42 


92 


Thorndike Uentnl 
Alertness A. 




Seniors 


.39 


92 


Thorndike Mental 
Alertness K. 




Freshmen 


.37 


182 


Thorndike Mental 
Alertness A. 




Freshmen 


.37 


182 


Thorndike MenUl 
Alertness K. 




Freshmen 


.23 


182 


Reasoning I Rogers 




Freshmen 


.12 


182 


Reasoning la Bog. 


Colvin 


Freshmen 


.5981 


103 


Brown U. Testa 




Freshmen 


.4567 


210 


Army Alpha 


The coefficient of correlation in 


the studies 


. cited in which tests 


other than the Stanford Binet wer( 


J used ranged from .09 to .59 but 



in most instances varies by not more than ten points from our 
results with the Thurstone Tests. The only results comparable 
with ours for the Stanford Binet are Caldwell's. Here the 
coefficient of correlation for Sophomores was about the same at 
that in our results for Sophomores in Group II but the coefficient 
of correlation for Juniors was much larger than ours due perhaps 
to the difference in the size of the groups. 

The fact that in our study scores in intelligence tests and college 
marks do not show closer agreement may be explained in several 
ways. In the first place, as has been pointed out earlier in this 
study, the students dealt with are a highly selected group from 
which the less able individuals have been for the most part elim- 
inated by failure to pass the entrance examinations. All bat seven 
cf the 201 students given the Stanford Binet have I. Q.'a above 100 
and the large majority of the students have mental ages above 
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Be\'enteen. As to Thurstone BCores the lowest student in Group II 
scores at the 19th percentile according to the norms for this test. 
The lowest student in Group III also scores at the I9th percentile. 
The level of intelligence in the case of practically every student 
is high enough to warrant adequate work in college if interest, 
habit of work and the necessary preparation are also present. 
Factors other than intelligence may therefore play a large part 
in the student's success. 

In the second place very intelligent students have often not been 
trained to work to the limit of their capacity in the lower schools. 
Their mental level has been high enough to enable them to do 
fairly satisfactory work with a minimum of effort. These students 
enter college with inadequate preparation as shown by low grades 
in entrance examinations and with the habit of working only 
enough to "get through." If this habit persists through all four 
college years it may lead to a very intelligent student's receiving 
poor marks. 

In the third place some of the most intelligent students are not 
interested primarily in college work, and unless pride in academic 
success is sufficient to make these students put forth a deter- 
mined effort to obtain high grades most of their energy may find 
its outlet in extra curriculum activities. 

Lastly the low correlation between the two intelligence testa 
used by us (.223) suggests that the validity of one or perhaps 
of both as tests which will differentiate between mental levels in 
adults may not be as great as could be desired. It may well be 
that we are expecting more of the tests of college students than 
we have expected of tests of children below fourteen. Our problem 
here is that of differentiating between abilities at the top of the 
scale, a far more difficult one than that of separating into groups 
the whole range of mental ability. It is probable that this problem 
will require as many years for its solution as elapsed between 
Binet's first experiments with the thirty teats in his original series 
and the publication of the Stanford Revision of the Binet Tests 
in I91B. 

Full cooperation of college authorities and experimenters in 
the field of adult testing will, it is to be hoped, produce tests 
as valuable to the college as the Stanford Revision of the Binet 
Test has been to the lower schools. 
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A RE-INTERPRETATION OP THE STATISTICAL 
METHOD OF ARMY TRADE TESTS 



By Arthur W. Kornhauser 
University of Chicago 



The procedure followed by the Army Trade Test Division in 
the construction of oral trade testa has been described in several 
books and articles'. We shall, therefore, include in the present 
paper only a brief summary of the statistical method used in 
the treatment of test questions. This will serve as a basis for 
oor critical discussion. 

For each trade question on which standardization data were 
collected, a ^aph like that shown in ^'ignire I was constructed. 

The question is scored from 4 to 0, for a correct answer, for 
incorrect, and intermediate scores for partially correct answers'. 
In the graph the scores are read in the column to the left, while 
across the top are arranged the four trade classes — Novice, 
Apprentice, Journeyman, and Expert. The number of men of 
a given trade status making each score is entered in the table. 
Thus, 2 Novices scored 4; 8 Apprentices scored 4; 18 Novices 
scored 0; and so on. Twenty men of each class of ability are 
represented in the graph. The average score for each class is 
obtained and entered at the foot of the chart. These averages 
are plotted and a curve drawn to show graphically the relation 
between trade status and score. On the basis of an inspection of 
these graphs questions were retained or eliminated. 

From those questions which were selected as showing sufficiently 
"good" graphs, the ones were retained which, in combination, 
would give the best discrimination between Novices and Appren- 
ties. Apprentices and Journeymen, and Journeymen and Experts. 
The final test consisted of some ten to twenty questions, the 
combined score on which was then used in classifying the individ- 
ual tests. 

We shall attempt to examine critically both the treatment of 
individual trade questions and the method of combining and using 
these questions. The first — the manner of evaluating questions — 

'The l'iTK..nnfl1 SyKti-in <•! I1ir> Cnllpd SHiIph Aciiiy. W:i«lilnitton : 
J. r. ri.ii:nii:in. Tmr'li- Tcbih. ' Xi'w Vi.fli : ir".U, I'.iL'l. 
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requires a statistJcnl re-interpretation. The second, which has to 
do with the form of the test as a whole, is principally a matter 
of convenience and practical usefulness. 

The method of evaluating the individual questions appear at 
once to be open to criticism reganSiing the statistical logic 
employed. The procedure makes use of the wrong regression line 
in considering the relation of ability and score. The inquiry 
made by the technique used is: What are the average scores 
made by tradesmen of the several grades of ability? The proper 
question would be: What is the average (or most probable) 
trade status of tradesmen making a particular score on a question? 
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Figure 1. 

On more careful examination, however, it will be found that 
while the procedure described does plot the wrong regression line, 
actually that regression relation is not used as a means of pre- 
diction. The regression equation that is, is not made use of 
either explicitly or implicitly. 

In order to make clear the indirect use to which the regression 
of score on trade status is put, we shall first discuss the logic 
underlying the evaluation and combining of questions. It will 
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then be noted wherein the ArRi)r method meets, and wherein it 
does not meet, the statistical requirements. 

The problem which we have, if we ask how well we can 
actually predict trade status from score on the individual question 
may be formulated more definitely thus: What are the numerical 
odds that a man passing (or failing) a question is of one trade 
status rather than another? 

A logical procedure for determining these odds follows: 

(1) Let n , a , j , and e represent the numbers of Novices, 

Apprentices, Journeymen and Experts respectively 
who take a given question,!. 

(2) Assume that n = a = j = e . 

(This is done in practict 
by referring results to i 
each trade class.) 

(3) And let n , a , j , and e represent respectively the num- 

bers of Novices, Apprentices, Journeymen, and Ex- 
perts who give a "right" answer to the question x. 

(4) Similarly n , a , j , and e represent the numbers who 

give a "wrong" answer to the question. 

(6) Then clearly, the ratio of a to n expresses the odds 
that a man passing question x is an Apprentice 
rather than a Novice, assuming n = a ^ j ^ e . 

(6) Corresponding statements hold for the ratios j to a 

and e to j , and (or ratios using percentages of 

failures in place of successes. 

Now these numerical expressions of the odds constitute pre- 
cisely the sort of relations we desire save, of course, that we 
must in practice take into consideration the actual inequality of 

n , a , j , and e . The proper allowance for these inequalities 
can be made only on the basis of data which will indicate roughly, 
at least, what the proportion of Novices, Apprentices, Journey- 
men, and Experts are among men actually applying for employ- 
ment in the given situation. 

(7> If now, N, A, J, and E represent the actual numbers of 
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tradesmen applying, 
A > 
1, X = the odda that a man who passu 

N n 

question x is an Apprentice rather than a Novice. 
That ia to say, the formulation of (6) must be 
corrected by weighting the items in accordance with 
the actual number of Novices and Apprentices who 
are applicants. It is to be especially noted that 
for the purpose of comparing one question with 
another the weighting is wholly unnecessary. Since 
it remains constant, the relative merits of questions 
can be judged quite as well by using simply the 

ratios of the type, . 



The expression (8) stands, then, as the general answer to our 
question, by stating simply what the odds are, that a man passing 
a question is of one trade status rather than of another. Cor- 
responding expressions may readily be written for other class dif- 
ferentiations and for situations in which the answer to the trade 
question is wrong instead of right. 

Let us now return to the Army procedure and examine it in the 
light of the preceding discussion. When the average score on a 
question was obtained for each trade class, what was really secured 
(as is evident from the nature of the computation) was the per- 
centage of the class who passed, multiplied by a constant factor, 4. 
The regression line that was graphed, therefore, may be thought 
of simply as a curve showing the per cents of individuals passing 
at successive trade levels. 

To the extent that the regression line or curve of per cents was 
of use in comparing the percentages of passes at adjacent trade 
status levels, it possessed a certain value in indicating the proper 
selection of questions; to the extent that it gave a false notion 
of the relative excellence of differentiation at the several levels, 
it was unsatisfactory. The sharpness of rise in the curve between 
two groups was considered the significant fact. The height of the 
point from which the rise takes place plays an important part 
which was not sufficiently considered in the Army procedure. 
Consider this point in greater detail. As indicated in our theore- 
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ticat discussion, the critical expressions for determiniiiK dlffer- 

X 

a 
■entiation are the ratios of the typ e, r , This ratio can 



be obtained directly from the curve plotted for each question in 
the old procedure. For example, (See Fignire 1) if the curve 
rises from .4 (Novice average) to 1.6 (Apprentice average), the 
desired ratio is 4 (i.e., 1.6 divided by .4). In Army practice this 
ratio was not read. What was taken as a criterion (usually im- 
plicitly, through estimated steepness of the curve) is the absolute 
difference between successive points on the curve in the example 
Just given, 1.2. Suppose, now, that the next point on the curve, 
the Journeyman average, was 2.8. The absolute difference and 
the steepness of the curve remain constant; but the ratio which 
was 4 at the first division is l?i at the second. Actually, that 
is, the question differentiates very much better between Apprentices 
and Novices than between Journeymen and Apprentices, although 
the Army method of analysis shows equally good differentiation. 

The shortcomings of the Army procedure can, perhaps, be 
made clear by reference to a few sample graphs of questions. 
These are shown in Figure 2. A man passing question B re- 
ceivcs the same credit as one passing A, even though passing B 
is almost certainly diagnostic of Expert status whereas half the 
men passing A are not Experts, one sixth actually being Novices. 
Question C is considered a good Journeyman question; D is re- 
jected. Note, however, that passing of D means that a man is 
practically certain to be either Journeyman or Expert while pass- 
ing C gives a much lower probability. The same is true for failure 
on the question. E illustrates the sort of question discussed in 
the preceding paragraph. A man passing this question is four 
times as likely to be an Apprentice as he is to be a Novice, while 
he is only two and a half times as likely to be a Journeyman as 
an Apprentice. Nevertheless, this question is considered a Jour- 
neyman question simply because the curve rises more sharply 
at that level. 

In concluding this discussion of the Army procedure a word 
is to be said regarding the satisfactory (on the whole) results 
obtained. Two prime requirements for Army trade tests were 
speed of production and simplicity of administration. These re- 
quirements were met by the technique used. Any slight gains in 
accuracy that could have been made through more refined statis- 
tical treatment, it may well be argued, would not have been worth 
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the trouble. The fairly good results th«t were obtained by roufrb 
methods were in part due to the following considerations: .(1) 
Questions were combined that did show good diiTerentiation at 
the several trade levels. The differentiation was satisfactorily 
shown by the inexact method for the reason that ordinarily very 
good differentiation occurred at only one class division and this 
division point could be detected by merely noting the rise in the 
curve. Hence good results were secured though it seems reason- 
able to believe that the same quality of results might have been 
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obtained with shorter teats and less waste of questions. <2) Since 
a fairly large number of questions was asked, the errors made in 
crediting separate questions were likely to be compensating. 

The conclusion that the Army method of evaluating questions 
was at fault and that the practical choice of questions was to some 
extent adversely influenced by the statistical method utilized 
appears to be justified. The question at once arises whether a 
more satisfactory trade test method can be built, using the sort 
of ■'.atietical foundation we have outlined. The remainder of 
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the paper will be devoted to tome tentative suggestions for r 
type of trade test vrhich does make use of the method presented 
for the evaluation of single questions, and which will at the same 
time have certain advantages as compared with the Army tech- 
nique in the manner of the combining and using of questions. 

The Army oral trade test consists of a fixed list of questions with 
norms established for the total list. A method of teat construction 
which would make possible the treating of individual questions as 
standardized units, in place of having the entire test as the stand- 
ardized unit, would have decided advantages in point of practical 
usefulness. Among the advantages are: (1) The test may be 
made more brief when desirable. (2) It may be varied to prevent 
coaching and to allow for unusual circumstances. (3) In test- 
ing the examinee it is unnecessary to give questions of all de- 
grees of difficulty; that is, questions less difficult than those already 
passed need not be given, nor questions more difficult than those 
already failed. (4) The test may be continually developed by the 
incorporation of new questions, standardised in connection with 
the use of the existing questions. (5) Questions which prove 
undesirable for any reason may be dropped without necessitating 
any change in the remainder of the test. 

In addition to these practical advantages listed, a system of 
trade test construction based upon the theoretical discussion in 
Part II, would have a more logical statistical foundation than have 
Army trade tests. 

What, now, are the difficulties in the way of a new trade test 
method of the sort we have been pointing toward? Is it possible 
for us to lay down some definite suggestions as to the form of a 
trade te.st built on the single question basis and to outline a mode 
of procedure? The answer is that there exists one most formid- 
able obstacle, namely, the absence of a sound method for com- 
bining the results from the single questions. Concretely, how 
shall we combine the ratios showing the odds in an example such 
as the following? Let its say the applicant is given five questions, 
three of which are passed and two of which are failed. We have 
the following odda from the several questions: Question 1 
(passed) shows that his chances of being Apprentice rather than 
Novice are 9 to 1; question 2 (passed) shows that his chances of 
being Journeyman rather than Apprentice are 7 to 3; question 
3 (failed) shows that his chances of being Expert rather than 
Journeyman are 2 to 8; question 4 (passed) shows that his chances 
of being Journeyman rather than Apprentice are 8 to 2; and 
question 5 (failed), shows that his chances of being Journeymen 
rather than Apprentice are 3 to 7. What, now, are the probabil- 
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itiea that this individual is a JourneyinRti, Judging on the basis 
of all the questions T 

The usual way to combine probabilities in answer to such a ques- 
tion is to multiply the ratios. Thus, in coin tossing, for example, 
the chances that one coin will come up heads is 1/2; the chances 
that two coins will come up heads at the same time is 1/2 x 1/2. 
Applying this sort of method to the above example, we would 
obtain the combined odds from the five questions by multiplying 
9x7x2x8x3 9 

the ratios given. We would have, that is = — . 

1x3x8x2x7 1 
But this gives false results. This multiplying of probabilities is 
based upon the assumption of independence (lack of correlation) 
between the several events. However, the passing and failing of 
particular trade questions is clearly not uncorrelated with the 
passing and failing of other trade questions. It might appear 
at first that we could correct for the intercorrelations among 
questions fay means of the partial correlation procedure. This, 
however, is impossible because of the inapplicability of the partial 
correlation method in the case of non-linear regressions. That 
the regressions of trade questions are not linear was clearly dem- 
onstrated by Army experience. The writer knows of no way by 
which this problem of combining probabilities from different trade 
questions can be handled mathematically. 

We apparently, then, are forced into a position where we must 
either abandon the proposed sort of trade test or find some make- 
shift for combining questions. We shall briefly state one or two 
tentative suggestions in the latter direction. An empirical proce- 
dure for combining individual questions, even though it fall far 
short of what would be theoretically desirable, may nevertheless be 
sufficiently valuable to warrant the use of the proposed sort of 
trade test. 

We shall mention two possible lines along which an empirical 
procedure might be developed. The essential requirement is that 
due provision be made to guard against the use of many closely 
intercorrelated questions in the examination of an individual. 
This may be accomplished either (1) by classifying appropriate 
questions into fixed groups pl;iced at several levels of difficulty 
(analHgous to Binet age groups), or (2) by having at each level 
a large number of questions which are sorted into classes of ques- 
tions having relatively low correlations with questions in other 
classes. 

The first of these suggested possibilities has some, but not all, 
of the advantages earlier mentioned as characteristic of a teat 
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which would flexibly combine single standardized queations. In 
this method we would have a compromise between the standardized 
single question and the standardized complete test. Here, the 
whole group of questions at the Apprentice, Journeyman, or Ex- 
pert, level must be treated as a unit. This trade level form of 
test, while somewhat similar to the Btnet age level method, has 
several significant differences. Among these are the following: 
(1) Questions are placed at the level where they differentiate 
best, not where a certain per cent of the individuals tested have 
passed. (2) Questions are weig-hted in proportion to their differ- 
entiating value; i. e., on the basis of the probability ratios earlier 
discussed. (3) Questions are weighted differently if passed and 
if failed. (These modifications would appear to be applicable to 
age-level tests like the Binet as well as to trade tests.) 

The second suggestion of a procedure for trade test construc- 
tion has certain advantages over and above those of the fixed 
trade level grouping just considered. It is essentially the same, 
save that greater flexibility is introduced in the use of questions. 
It carries very much further the idea of alternative tests which 
have been placed at some of the age-levels in revised Binet tests. 
In place of having a fixed set of questions at, say, the Journey- 
man level, we have a great many questions. These are classilied 
according to the divisions into which trade knowledge in this trade 
has been analyzed. In examining a candidate, the questions 
which are asked at a given trade level are chosen from the 
several classes into which the questions at that level have been 
distributed. This method appears to be a feasible empirical de- 
vice to prevent a candidate's being judged upon his answers to a 
non-representative and highly intercorrelated set of questions. 

We shall not enter into a description of the detailed methods 
of weighting, scoring, and combining scores, which would be used 
in the suggested procedure. Suffice it to say that the actual pro- 
babilities calculated for each question can be transmuted into 
simple "weights" (consisting of numbers proportional to the lo- 
garithms of the ratios of odds) which may then, at each level, be 
readily added. The sum of the "weights", regardless of the 
number of questions asked, will give a rough indication of the 
odds that the candidate is at that level or below it, based upon all 
the questions asked at that level. The questions are, of course, 
in this way being used as though they were not intercorrelated. 
For adding the logarithms is equivalent to multiplying the ratio 
and this is the theoretically correct method of combining pro- 
babilities when the events are uncorrelated. The composite pro- 
bability that we get is, therefore, only a very rough approximation. 



We may briefly 

I. The statistical procedi 
appears to be open to critici: 
of teat score on trade status 
tionship. Closer considerati 
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But inasmuch aa the queations have been elaasiiied into groups 
not closely correlated with questions in other groups, and inasmuch 
aa the combined probabilities will be thrown olf in about the same 
degree and in the same direction for all candidates, the procedure 
appears to be usable. We ag-ain emphasize, however, that the 
method ia offered only as a' tentative suggestion, a makeshift pro- 
cedure which may have advantages over the rigid type of Army 
trade test. 

IV. 

as follows: 

e used in building Army trade testa 
n on the grounds that the regression 
'as used in place of the reverse rela- 
1 reveals, however, that the regres- 
1 relations which were calculated were not used as such. 

2. In order to make clear the indirect use of the figures cal* 
culated in evaluating each teat question, we have outlined, without 
reference to Army procedure, a logical basis for evaluating questions 
in terms of the probability relationships of trade atatua to scores 
on single queationa. 

3. The Army method was then compared with our discussion 
of a method which would use mathematical odds for each question, 
and the conclusion was reached that to a certain extent the Army 
procedure was actually comparing such percentage ratio, but not 
in a logically correct manner. The method used worked tolerably 
well, but, as shown by a few illustrations, it also failed in part. 

4. Finally, we have attempted to suggest lines which a differ- 
ent technique of trade test construction might follow, based upon 
the theoretical discussion contained in the paper. The principal 
advantages of the proposed sort of test are indicated as well as 
the special difliciilties involved. 



A CASE OF SECONDARY MENTAL DEFICIENCY 
WITH MUSICAL TALENT 

By Blanche M. Minogue 

Before medicine and psychology had advanced to their present 
degree of development, the obviously defective in intelligence were 
regarded aa being possessed by some superior power. The occa- 
sional "idiot-savant" with his extraordinary abilities must have 
seemed convincing proof of that theory. Modern psychological 
methods, however, enable us to understand to some extent these 
heretofore inexplicable creatures. In recent years several cases 
have been reported in considerable detail. They are usually moder- 
ately high grade defectives who possess special abilities, which 
stand out in startling contrast to learning ability, judgment, etc., 
which are noticeably below the average. 

Among "idiot-savants" are occasional musical geniuses who are 
almost phenomenal. Although musical genius in itself is appar- 
ently something apart from general intelligence, it involves many 
of the attributes of intelligence. For this reason a case of marked 
musical talent combined with low general ability is the more 
remarkable. Such a case is that of a male patient, at Letchworth 
Village at the present time. 

X, Y., a twenty-three year old boy, with a mental age of about 
seven years, is a pianist of marked ability. He has been in the 
institution for several years, and in that time has played at 
practically all of the social functions of the institution. 

The family history seems free from any intelligence defect. 
The paternal line is of normal, if not superior, mentality. The 
father's father was a broker, and one cousin, an engineer, has 
been a successful inventor. The father, born in Hungary, earns a 
moderate salary as a shipping clerk. The father's mother is a 
pianist of exceptional ability. His sister's daughter is also an 
unusually gifted pianist. The other members of the family, in- 
cluding the father himself, show musical ability in moderation. 

The maternal line is interesting. The mother, also born in 
Hungary, is a woman of superior intelligence and refinement. The 
entire family appear to be of more than average mental ability. 
All have achieved success in business. One brother has two 
children who were pronounced superior after a psychological ex- 
amination. This branch of the family shows considerable emotional 
instability, and does not give any indication of musical talent. 

The patient's sister is a very bright, attractive young woman of 
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about twenty-one years. She ^aduated from high school, winninK- 
recognition for her scholarshp. At present she ia working and 
carrying college work in Extension School. She is a violinist, but 
does not show unusual talent. 

The patient was born in 1900, in the United States. Everything 
connected with pre-natal life was favorable. Birth and infancy 
were normal. He was a bright, healthy child, walking at twenty 
months and talking at one year. As soon as he talked he learned 
little songs in English, German, French and Hungarian. He learned 
quickly and appeared to have intelligence, as well as musical 
ability, far above the average. Even in infancy, however, the child 
had periodic attacks of temper. His mother describes him as very 
amiable until some emotional experience such as surprise caused 
a sudden passionate outburst. 

The boy developed normally until the age of three years. At 
that time he was severely ill with pneumonia, with complications- 
which have since been diagnosed as meningitis. In the delirium 
of the disease he sang incessantly the songs he had learned. 
For many years after his recovery he showed great reluctance to 
sing. After this illness the child frequently had violent screaming 
spells and soon showed mental retardation. When seven years 
old he was taught at home for a year by a special teacher, and 
then entered grade 2A in the public schools. He made fair pro- 
gress in reading, writing and arithmetic, but was teased so unmerci- 
fully by the other children that he had to be removed from achooL 

He received piano instruction for two years under excellent 
teachers but was very abusive to them. As he became older he 
often became voluble on the streets, and attracted crowds of people. 
He became the victim of unscrupulous persons in the neighborhood 
and so was committed to Lctchworth Village. 

Since admission to the institution X. has not been a discipline 
problem. He does light work around the cottage, and plays the 
piano much of the time. As he is not very robust he requires 
sleep during the day. He lacks many characteristics of the feeble- 
minded. His muscular coordination is very good; he walks 
briskly, without the usual shuffling gait of the mental defective. 

X. takes great pride in his musical accomplishments. He plays 
the most difficult music by sight and b> ear His ability to render 
classical and concert pieces, as well as the modern "jazi," is note- 
worthy. In a recent test before a woman of considerable musical 
training he played the Anvil Ckor»s from "II Trovatore," Lohen- 
grin, the Tannhauser Marcli, Tarantella, Carmen, Chopin's Fun- 
•ral March and many other classics. He read at sight the Marcht 
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CnUtgue by Stndinfr> Chaminade's The Flatterer, and Heart't 
Melody by Enselman. He then accompanied the phonograph in 
playing Humoretque and the Blue Danube Waltz, and bad no 
difficulty in selecting the right key. He alao read at sight the 
accompaniment for a vocal soloist. His emotional instability 
obviously has an unfortunate effect uponhis playing, but he plays 
accurately and with feeling when his attention is focused upon 
his music rather than upon the admiration he is exciting. The 
music instructor at the institution considers his technique very fine 
for his hmited period of study. His pitch discrimination is 
remarkable, and his tonal memory unusually good. His sense 
of rhythm seems to be more affected by his emotional state than 
are his other abilities, and consequently is more variable. The 
most important single factor in the boy's talent seems to be his 
memory. For time, for places, for events, for any composition 
ever learned, he has a memory almost phenomenal. That he 
has Idnaesthetic memory also, is evidenced by his habit of playing 
without looking at the piano. Hts ability to imitate is considerably 
beyond his mental age. In the Knox cube test he made no failures. 

Unfortunately, this patient is deteriorating mentally. On his 
admission to the institution in 1914, age fourteen years, his intelli- 
gence quotient was .62, at twenty years of age, his I. Q. was .54 
(mental age eight years and six months) and a recent test gave 
him an I. Q. of .46 (mental age seven years and five months) by 
the Stanford Revision of the Binet-Simon. In this last test his 
basal year was four. At the five year level he failed the "patience" 
test, and in the sixth year passed all but the mutilated pictures. 
At the seventh year he failed to give differences and received only 
half credit for tying the bow. At eight years he failed the ball 
and field and the comprehension tests, and could not count back- 
wards. At nine he knew the date, could make change and give 
rhymes. The subject failed all tests at the ten year level. The 
greatest deterioration appears to be in comprehension and judg- 
ment. At present he seems to fall at about the six year level In 
tests of these functions. In Burt's reasoning tests he made a 
score of 1.75, giving him a rating just below the seven year level. 
His score in the Indiana University Primer scale was 42, (the 
median for six years is 43.3). He was unable to go above the 
fifth year in the Porteus Maze tests. 

Emotionally, this boy is excitable, egocentric, usually cheerful 
and obedient, but very sensitive and wholly incapable of a social 
existence. He does not mix with the other boys, and leads a life 
really apart from them, although one feels that he craves comrade- 
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Bhip, but does not know how to fret it. 

There are two particularly interesting features of his talent 
One is his failure to produce any original composition. This may 
be the result of defective intelligence. The other is his inability 
to learn to dance. He seems to have no comprehension of the 
relation of the musical rhythm to hia own movements. This ap- 
parently is not dependent on intelligence, for many low grade 
defectives are excellent dancers. 

The study of this case is by no means a complete one but it 
serves as one more bit of evidence that musical ability is a thing 
apart from "general intelligence." It is interesting that the 
disease which robbed the child of his heritage of intelligence and 
increased his emotiona 1 instability, left apparently intact this 
special talent. It is perhaps purely a matter of chance that he was 
left with one intellectual trait, his unusual memory, unimpaired. 
This fortunate combination of memory, sense of rythm, pitch dis- 
crimination, etc., makes a striking talent. Were any one of these 
lacking, or destroyed, the whole gift would go with it. 



THE FRANZ DOT TAPPING TEST AS A MEASURE 
OF ATTENTION' 



By Irene Caae Sherman 



In his "Handbook of Mental Examination Methods'" Dr. Frans 
describes various teats of attention, among them a test of the per- 
formance of accurate movements. Cross section paper (2 or 4 
squares to the inch) is used; "The subject is instructed to tap in 
each square as rapidly as possible, going to and fro.'" The experi- 
menter notes the time for the taps along the particular lines. The 
test may be made with 300 squares, 20 squares to the line. 
Emphasis is placed neither upon accuracy nor upon speed, since 
the aim is to discover variations in attention. 

In a personal communication Dr. P^anz advised the use of 10 
squares to the line with 30 lines for children. He states that the 
individual sets his ovira speed, but is expected to keep up the same 
speed throughout the test. With a speed not the maximum the 
rate can be kept up constantly with a variation of not more than 
10%. He believes that the test shows ability to keep up progressive 
work, and also indicates "atick-to-it-ness." He also points out 
that the test shows the relative performance of the individual at 
different times, and does not give a comparison of different 
individuals. 

In an effort to find an accurate means of measuring fluctuations 
of attention in children, this test, with a number of so-called 
attention tests, was given to 172 unselected cases'. Cross section 
paper four squares to the inch was used, with ten squares to a row 
in a series of thirty rows. The instructions to the child were, "Put 
a dot in each of these squares, beginning here and going across 
to here (examiner indicated the distance of the ten squares), then 
coming back on the next row, and so on down to this line (indi- 
cating the base line which marked off the thirty rows). Do this 
as fast as you can, but be sure to put a dot in each square, and 
don't miss any squares." The time for completing each row of 
squares was taken. 

The results indicated such a wide variability of performance in 
children that it was felt to be necessary to esUblish a more 
accurate norm than the 10% variability suggested by Dr. Franz, 

'Dr. Frani Joea not name tbla teM, but the irrller feels "Dot Tapping" 

■FraDE, Sbeptierd Ivory, IlandboOk at Mental BnnlROflM IfefAodt. The 
MBcMlllao Company, 1U3U. 

■Ibid. P. sa 

*Ini>iltute for Juvenile Kestarcb, Chicago, IlllnoU. 
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provided the reanlts would lend theinaelves to such a Btandsrdi- 
zation. 

Each child was ^aded by the Stanford Revision of the Binet 
test, so that a mental age and intelligence quotient was available 
in each case. In each case the arithmetic mean, the range and th» 
average deviation of time were taken, as well as the coefficient of 
variability. In order to discover the influence of age, mental age 
vnd intelligence rating upon performance in the test, the resulta 
are arranged according to these three ^factors, and are presented 
in tables I, II and HI. 

Table I indicates that there is a general decrease in average 
time, average range and average deviation with increase in 
chronological age. This decrease, however ia not sufficiently regu- 
lar to make the chronological age a basis of standardization of 
performance, and is no doubt due to the increase in speed due 
to better motor co-ordination which develops in advance in age. 
The coefficient of variability showed an even greater variability in. 
TABLE I 

J TO CIIRONOI.OOICAL AGE 

Average Average Coefficient No. of 

Range Deviation of Cases 

Variability 
13.9 2.26 19 9 





RESULTS Ai 




Average 


Age 


Time 


7-0 


11.27 


8-0 


12.78 


9-0 


7.85 


10-0 


6.84 


11-0 


6.72 


12-0 


5.62 


13-0 


5.65 


14-0 


3.9S 


15-0 


5.16 


16 + 


5.11 



3.7 .77 15 17 

TOTAL 172 

relation to age, so that it indicates no relation between variability 
and chronological age. 

Table II shows the same tendency for average time to decrease 
with increasing mental age, the average range and average devia- 
tion also show this decrease, but not to such a marked extent as 
average time does. While this decrease in average time is quite defin- 
ite, yet the differences between any two mental ages are too small 
to make the average time a basis of scoring in terms of mental 
age. The coeflicient of variability, as in the case of chronological 
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Bge, shows greet variation, and no relation to mental age. 

Table III indicates that none of the measures showed any rela- 
tion to intelligence quotient. 

Table IV and graph 1 give the distribution of the coefficients 
of variation for the entire number of cases. The median coefficient 
is 14.76 and the inter-quartile ranges from 11 to IS inclusive. 
That is, fifty per cent of our cases have a coefficient of variation 
between 11 and 18. A score falling between these numbers, then, 
indicates a normal performance in this test. The upper quartile 
ranges from one through ten, and any score between these numbers 
would be considered an excellent performance in this test. A 
score of nineteen or above is considered to show a fluctuation of 
attention greater than that shown by fifty percent of our cases. 

Graphs 2, 3 and 4 illustrate the increased variability of perform- 
ance of individuals with a coefficient of variability above 18. The 
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Age 


Average 


Average 




Average 


Coefficient 


Nc.of 




Time 


Range 




Deviation 




of 


Cases 












Variability 




5-0 


9.17 


6.0 




1.16 




13 


1 


6-0 


13.52 


10.3 




1.98 




15 


11 


7-0 


10.45 


13.7 




3.17 




23 


16 


8-0 


6.97 


5.2 




1.01 




14 


26 


9-0 


6.31 


5.3 




.97 




15 


28 


10-0 


5.42 


5.5 




.89 




16 


32 


11-0 


4.56 


3.0 




.63 




14 


14 


12-0 


4.85 


3.3 




.67 




14 


15 


13-0 


4.09 


2.6 




.43 




11 


14 


14-0 


4.03 


2.8 




.43 




10 


7 


15-0 


4.95 


4.1 




.89 




17 


4 


16 + 


3.55 


2.0 




.34 




10 


4 
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TABLE IV 

DISTRIBUTION OF COEFFICIENTS OF VARIABILITY— 



3- i .. 



25 percentile 10-11 16 

11-12 12 

12-13 12 

Median 13-14 13 

14-15 8 

15-16 8 

16-17 12 

75 percentile 17-18 13 

18-19 7 

19-20 9 

20-21 5 

21-22 3 

22-23 

23-24 3 

24-26 S 

25-26 8 

26-27 

27-28 1 



31-32 

82-33 

33-34 

34-36 

35-36 

36-37 1 

37-38 

38-39 

39-40 

40-41 1 

172 
require on the whole a ^eater length of time to complete the 
test than subjects with average coefficients. This difference is 
■more marked in the case of the average deviation, where the 
■messurp,'^ aro greatly dispersed for those coefficients above 19, 
while \}u<'=i: bfk)w 18 show a central tendency around a low 
average deviation. The mode for those making an excellent 
score (3-10) is .1 while the mode for the average group is some- 
what higher, namely .7. The range of time taken on the teat ia 
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also higher for those with coefficients above 18, being more widely 
distributed than the measures for the lower coefficients, which as 
in the case of average deviation, show a marked central tendency 
around a low score. These graphs clearly show that a high 
coefficient of variability is accompanied by increased total time 
of performance, increased range of time from line to line, and in- 
creased deviation from line to line. Since it has been shown 
above that the coefficient of variability is independent of age, men- 
tal age and intelligence quotient, it may be assumed that the 
variability of the coefficient is due to some other factor, presum- 
ably fluctuations of the attention. 

Graph 5 illustrates the typical kinds of performance on this 
test. The first curve has a coefficient of variability of 4, which U 
superior performance. The average time is live seconds, with 
long periods of no variation from this average time; there are 
no great deviations from the average from line to line, and the 
total range of time is only two seconds. The second curve is 
that of an average performance, with a coefficient of variability 
of 14. The average time is also five seconds, but there are no 
long periods of unvaried performance, although on the whole 
the deviations are slight. The total range of time, however, ia 
five seconds. Curve three is a curve typical of a high coefficient 
of variability, in this case 20. The average time here is 13 seconds, 
with no periods of invariable performance. There are constant 
deviations from the average from line to line, with a wide totkl 
range of time, namely, 15 seconds. 

In the giving of the tests it was often noticed by the examiner 
that children frequently varied the size of the dot, began making 
circles, heavy dots, two dots in one square, etc. This was often 
interpreted as due to low chronological or mental age, or to low 
general intelligence. Since the results showed no relation between 
these factors and the coefficient of variability, a study of the dot 
patterns was made. This revealed that the variability of the 
size of the dots had little relation to the score. Subjects who 
changed from a large dot to a small dot, or vice versa, did 
not necessarily make a poor score. In fact, many changes in 
the size of the dots occurred with no change in time from line 
to line. On the other hand, many subjects who made very 
poor scores showed a marked regularity in the size of dot. In 
only one case was there a definite relation between size of dot 
and increased time. This case, scoring 18, had a marked 
increase in time in two lines, with a change in dots in these lines, 
making circles instead of dots in these two instances. On the 
other hand, of six cases showing lines with marked increase of 
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time with increase in size of some of the dots in this line, all of 
these cases also had other lines with increased rate of time and no 
chan^ in size of dots or other variations. While it is posaibU 
that a change in the size of the dot may mean a shift of attention, 
it is almost inpossible to say definitely that this is true, because 
of the large number of cases in which there was no evident re- 
lation between time and size of dot. Changs of time are just ma 
likely to occur where there are no changres in size of dot as wh«r< 
there are such changes, and on the whole these changes in six* 
of dot arc considered as insignificant compared with other un- 
Icnown factors which are producing changes in attention. In fact, 
it is believed that these changes in size of dot are but one of tha 
external manifestations of the variability of attention, relatively 
unimportant, since they seem to influence the total score vewy 
little. 

The records of the cases were analyzed in order to discover, if 
possible, any factors in the subject which might cause, or be cor- 
related with unstable attention. Because of the subjective natura 
of the analysis of the individual cases, with the marked lack of 
correspondence of descriptive terms used in the various records 
in presenting the history and mental analysis, a limited number 
of terms were arbitrarily selected as possibly having some re- 
lation to attention. In cases designated as negative none of thesa 
descriptive terms occurred. 

In Table VI the individuals are classified under the descriptive 
term which most nearly described them; the percentage distri- 
bution is given according to coefficients of variability. The table 
shows that the smallest percentage of individuals with a negative 
history occurs in the group with scores of 19 or above. This same 
group also showed a larger percentage of "irritability," "distract- 
ibility," "incoherence," and marked "slowness of reaction" than 
did the other two groups. Subjects described merely as nervous 
and restless were found not to show poor attention as measured by 
this test. It was also striking that individuals described as being 
poor in attention by various examiners or other observers in the 
home or school were not characterized by making an unusually high 
score, i. e., 5% of these subjects made coefficients from 3 to 10, and 
likewise 5% made coefficients of 19 ot above. Similarly, subjects 
with organic brain disease or psychoses were not characterized by 
a high score. Rather, the larger percentage of these were found to 
make an excellent score, namely 3 to 10, and were able to sustain 
attention over a short period of time, such as is demanded in this 
test. 



3-10 


42.1% 


11-18 


49.59& 


19 -i- 


28.2% 
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TABLE VI 

PERCENTAOB DISTRIBUTION OF TYPE OF CASH, 
ACCOKDING TO COEFFICIENT OF VARIABILITY 
Dt Nerroua H^peracttTa, 

I>nnr nnd DlBtincclbl* 

n ReBllcBR L'DHtable Irrluhle and FUgbtr 

18.4 7.9 2.6 2.60 

9.6 1.0 9.5 3.21 

12.8 7.7 12.8 7.70 

VarlafiiUtT Inpohorent Slow ApathptLc Psychotic No rMord Total 

3-10 2.6 2.6 6.3 7.9 2.6 99.9 

11-18 12.6 2.1 8.4 100.0 

19 -I- 6.1 7.7 5.1 2.6 6.1 99.9 

CONCLUSION 

While average time, range and deviation decrease with increas- 
ing chronological and mental age, thia decrease is not sufBcient 
to make chronological or mental age a basis of standardization, 
since the increase is probably due purely to increasing motor 
■coordination which develops with increasing maturity. The better 
performance with increasing age, then, is not due to better con- 
trolled attention, since the variability of performance as measured 
by the coefficient of variability shows no relation to age. 

There is no relation between performance in this test and in- 
telligence quotient. Variability on the teat is due to some factor 
other than maturity or general intelligence, presumably fluctuation 
of attention. 

The inter-quartile range of coefficienta of variability for this 
group of 172 unselected cases was 11-18. A score within this 
range is considered average performance. 

A high coefficient of variability is accompanied by Increasing 
total time of performance, increasing range of time, and increas- 
ing deviation. 

Among cases showing a high degree of variability (score of 
19+) there was a greater percentage found to be "irritable," "dis- 
tractible," "incoherent" and "slow in reaction." Subjects described 
merely as "nervous and restless" were found not to show poor 
attention as measured by this test. Performance on the test 
showed that children described by observers in the home or 
school as inattentive did not necessarily make poor scores on this 
teat. Observed inattention in these cases is evidently not a real 
lack of ability to attend, but is expressive of some other factors. 

Similar results were reported in a recent article' on post-en- 
cephalitic children, where it waa found that, although these cases 
were described by observers as inattentive, by tests they proved 
■capable of sustained attention. The writers concluded that in 
their cases the apparent inattentiveness was the result of emo> 
tional disturbances'. 

"Shprmnn antl Beverly, The Parlor of Drtrrlorotlon In Chllirfft SAowlftf 
:BrltaiHor DlSlcaltlei Fottnniiit Bpldemie Bnecphatltii. Arcb. of Neit. * 
Psvch,. W£i, Vol. 10. pp. 3Z0-340. 

*Tht wriur )> indebted to H^nla RaTmakar VoxOiVnKunv lot uilVDih.™ 
In preparatJuu ot ibe data. 



AN ADVANCED COURSE IN EXPERIMENTAL- 
PSYCHOLOGY APPLIED TO ADVERTISING* 

By A. J. Snow 
Northwestern University 

It is obvious that the teaching of advertising without an ex- 
perimental laboratory is just as futile as teaching civil engineering' 
without a field course in surveying. However, there is a vital 
difference between the two: in the latter case an engineering 
student can check up the correctness of his surveying with tht' 
aid of mathematical computation; while in the case of psychology 
as applied to advertising the student, at the present, cannot 
verify his theories except by reference to a purchasing public to 
which he has usually no access. Nevertheless it is perhaps pos* 
aible to bring this contact about — between the student of advertia-- 
ing and the purchasing public— by a cooperative plan on the part, 
of the advertiser and the university. 

Obviously a student who would profit by such a cooperatiT*' 
arrangement cannot be a beginner in the field. It is vital that 
he should have some knowledge of the fundamentals of advertising- 
before he is admitted to such a course. It has been our policy to 
make the following prerequisites for the course in experimental 
advertising: one semester of general elementary psychology, on«- 
in marketing, and another semester in psychology as applied to ad- 
vertising. We are hoping that, in the last-named course, the student 
will become familiar with the application of psychological principles 
to the general field of advertising. To accomplish this end, tha- 
student is asked not only to read published material and listen 
to any new ideas brought out in the lectures, but also, as part 
of his home work, to criticise advertisements, select samples: 
of advertising illustrating good and bad applications of psychologi- 
cal principles, or lack of application, discover modern tendencies- 
and solve any problems which were formulated by the instructor" 
for the purpose of applying psychological principles to advertising. 
Some of these problems were of the following nature: one such, 
problem was as follows — Explain why advertising is limited to- 
the use of only two of the four possible ways of producing- 
attention. Illustrate. For the second example take the case of 
an Illinois farmer who wishes to advertise in the weekly news-- 

•Rr';icl lii'fcjri' till' unniiHl iiin'Iinc i>r The Nnlionnl Assixrl.illnn rif Teachers 
of AdvpptlHini: mi'Ptinir wiih Thi' AnKociiUPd AUvcrllsIne CIuIib of the Worlil,. 
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papers in order to market by express some new potatoes direct 
to the consumer. Three good papers are available, each covering- 
different territory. A full page of space in any of them would cost 
fifty dollars, smaller space in proportion. How can the farmer 
most profitably spend fifty dollars in advertising in a given week? 
Why? Here is still another problem — An advertising man lost his 
job, the reason being that he arranged for an advertisement to 
appear every other month in a monthly magazine. The excuse he 
gave was that the appropriation was limited to the cost of only six 
issues. Why did this advertising man get the worst of it? 

When a student has successfully completed this comparatively 
elementary course in advertising he can, in his senior year, or 
while pursuing graduate studies, elect the advanced course In 
experimental psychology applied to advertising. He can pursue 
this course cither one or two semesters, gaining academic credit 
proportionately to the work done, but not exceeding five credit 
hours during any one semester. The students in this course meet 
twice a week in one hour sessions for discussion and twice a week 
in three hour sessions for laboratory practice. 

The coarse itself is divided into two parts — individual problem* 
and class problems. The first part — individual problems — i* 
divided further into two parts, the division being based on the 
individual ability of the students in the group. The more pro- 
mising students are assigned problems of minor research, individ- 
ually or in groups, while the less capable students are assigned 
to perform standard laboratory experiments. For example, the 
following two are some of the problems of minor research assigned 
to the more capable students: — the first of these is an experi- 
mental study of the relative persuasiveness of types of adver- 
tising. Fifty types of advertising appeals were tried upon twelv* 
hundred day and night school students. The second problem 
was a study of the legibility of printing types as classified in 
groups with relation to their feeling tone. The less capable 
students were instructed to duplicate some of the well known ex- 
periments in the field of the psychology of advertising devised 
by such men as Scott, Gale, Hollingworth, and Strong. 

The second part of the course, required of all students, aims 
to supply the need of an actual contact with the buying public, 
and also attempts to bring before the students practical problems 
of advertising. In this, the applied part of the course, the student* 
were concerned with the actual field problems in advertising. 
While it is, strictly speaking, impossible to separate the actual 
business part of advertising from the application of psychological 
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principles to &dvertisinc practicrdl]/ at least, that can be done in 
« measure. The reason for such an arbitrary division, into the 
businesa and the psychological aspects of advertising, is that a 
course in psychology cannot teach the student how to run the 
business as a whole but only how to apply psycholosical prin- 
-ciples to certain aspects of it. 

The success of this applied part of the course depends upon the 
ability of the instructor in charge, or the university as his agent, 
to obtain the good will and cooperation of two important groups: 
first, small scale advertisers; second, a group of representative 
professional advertising men. The vicinity of the university to 
a large industrial city, while not absolutely essential, lends itself 
aplendidiy to this purpose. 

Again in this appiied. part of the course the class helps to 
determine the nature and function of the advertising which is 
submitted for its judgment by the small scale advertiser. In that 
way the class has the opportunity to verify its experiments and 
the validity of its claims for the application of psychological 
categories to the advertising of merchandise, just as much, as the 
engineering student is able to verify his surveying data mathemati- 
cally. In order not to go far wrong in the decisions of the class, 
and in this way waste time and money for its clients, the problems 
before the class and their decisions are discussed by the instructor 
from time to time with the above-mentioned advisory board com- 
posed of professional advertising men of high standing, chosen 
in such a way that they as a group represent the various types 
of advertising agencies now in existence. 

It is important to understand that the students in experimental 
advertising are not expected to represent artistically their ideas 
in the malting of the usual cut and copy. That is done for them 
and upon their bidding' by professional artists and copy writers. 
It is not the function of this class, or any other in the field of 
psychology as applied to advertising, to teach the technique of 
carrying out ideas in the form of cut and copy. The function 
must always lie with the schools of art and expression, and only 
with those students who possess such a capacity. 

For the sake of clearness it may be expedient to state some of 
the field problems which made up the task for the class: 

First. A local storage, and transfer company asked the clasa 
to consider its advertising problem, especially during the months 
of April and May, September and October. 

Second. A Chicago advertising agency requested the class to 
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■ugseat the method and the nature of the copy to be used in 
order to put before the public a new type of baby carriage. 

Third. A large manufacturer of paint asked the class, through, 
his Chicago advertising agent, to prepare for his use a pamphlet 
of information about the nature and utility of his merchandise, to 
be distributed by mail, coupon attached. 

Fourth. A manufacturer of garters requested the class to judge 
a secondary slogan with reference to its effect upon the potential 
buyer, and if necessary to construct a new slogan more suitable 
for its purpose. 

This is by no means the only method that can be used to teach 
that sort of course, but it is a method, we believe, that has had 
a certain degree of success. The primary purpose of this paper^ 
however, is to stimulate a vigorous discussion of the subject it 
presents. 



MEASURING THE COMPREHENSION OF ADVER- 
TISEMENTS 

By A. T. PoFFENBERGQt 

Columbia Univebsitv 

One of the most fundamental rules of a writer or a speaker i^ 
chat he shall "come down to" or not go "over the heads of his 
audience." The speaker may get an immediate reaction from his 
audience that will tell him whether or not he is obeying this rule. 
The writer, and especially the advertising copy writer, may not 
always be so fortunate. His returns from any one piece or series 
of pieces of copy may be extremely slow and indirect. Where every 
word costs many dollars, it is extremely important that each shall 
carry a message that will pay for itself and also bring a profit. 
To be sure, pictures will do much to carry the message, and may 
at the same time hide the unintelligiblity of the copy. But even 
motion pictures require some easily comprehended copy to make 
them acceptable. 

Advertising, particularly national advertising, is mass selling 
and to be elTective must appeal to the bulk of the public It is not 
easy to know the ability of this vast public to comprehend the 
printed message. In fact, no one seems to have even guessed at 
the level of intelligence, no called, of the white population of the 
United States until the results of the Army intelligence tests were 
reported. The percentage of illiteracy has received the most at- 
tention, altho the much larger percentage of low degree of literacy 
is quite as important. W|e need not here concern ourselves with 
the heated discussions as to whether the average adult has an 
intelligence of a thirteen, fourteen or sixteen year-old person. Most 
of these discussions center around the question whether printed 
symbols are adequate material for measuring native intelligence. 
We are here concerned with the capacity of the population to get 
the meaning of printed symbols, and with the degree to which 
the advertising copy-writer keeps within the limits set by the cap- 
acity of the average person. 

Now the average adult can read, understand and deal with 
printed symbols about as well as the 14 year old child, or one 
who has completed the elementary schools grades. It is to an 
audience of no higher type than this, about one half of the coun- 
try's population, that the advertiser of generally used commoditiea 
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must appeal. That is, this degree of capacity sets the limit beyond 
which the copy-writer should not g». 

1, To what degree does the copy-writer adjust his vocabulary to 
his audience? 

With our Httle knowledge of the make-up of the advertiser's 
audience, complicated by the shifting of maximum bujring power 
from the professional classes to the laboring classes, it is not safe 
to cling to an untested opinion on this matter. Moreover, it is 
a question which lends itself readily to experimental measurement. 
It one wants to know whether his copy is intelligible to his audi- 
ence let him try it on a sampling of that audience. The follow- 
ing studies are intended to show whether or not such tests are 
necessary and at the same time to show how they may be made. 

All the words, excluding the names of articles, were gathered 
from 190 advertisements appearing in one issue of the "Saturday 
Evening Post," "The Ladies' Home Journal" and the "Woman's 
Home Companion." There were in all 6378 words and when all 
repetitions of various sorts were eliminated, there remained 3796 
different words. This list of words was checked against the words 
appearing in the "Teachers Word Book," prepared liy E. L. Thorn- 
dike. This is an alphabetical list of the 10,000 words occurring 
most commonly in a count of about 625,000 words from literature 
for children and forty other sources. Of our list collected from 
the advertisements, only 4 percent failed to appear in the "Teachers 
Word Book." The copy-writer therefore, seems to keep fairly well 
within these limits. 

Fifteen of the words appearing in both lists were chosen at 
random and presented to 37 persons, none of whom had gone 
through High School, who were asked to give their meaning. The 
percent of errors for the different words including no answers 
and wrong answers, ranged all the way from 2.7 percent for the 
word "reputation" to 73 percent for the word "zest." The average 
percent of error was 12 percent. Six words appearing in the ad- 
vertisement word list but not in the "Teachers Word Book" list 
were now tried on the same 37 people. The percent of errors 
ranged from for "parasite" to 60 percent for "slush." Al- 
though 37 people of elementary school grade do not form an ad- 
equate sample of any one class of the population, these figures 
suggest that even such a word list as that in the "Teachers Word 
Book" would not be an adequate guide for the copy-writer to 
follow if he is to bo certain of understanding on the part of his 
audience. The percent of error was just as great for words ap- 
pearing in the list as for those which were not in the list. 

The following experiment with an actual advertisement showed 
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the effect of the poor ftdjustment of an advertisement's vocabulary- 
to its audience. An advertisement of the poster type for Premium 
Ham contained the following statement: "An Epicure's Way of 
Baking Ham." The whole appeal lay in the meaning and connota- 
tion of the word "epicure" and must have been intended to produce 
a favorable reaction in the lower half as well as the upper half of 
the population. 

Another advertisement was prepared, duplicating this one in 
every respect except that the word "Igorot" was substituted for 
the word "epicure." These two advertisements were shown to 
each of 53 housewives with the requests that they state which 
way of baking ham seemed to them the more desirable. Twenty 
nine chose the "epicure" advertisement while 24 chose the "Igorot" 
advertisement, indicating that they preferred to bake their ham 
the savage way. Since it appeared quite likely that some of the 
29 who chose correctly may have been only guessing, they were 
asked to g^ve their idea of an eqicure. Seventeen of them showed 
that they had sufficient knowledge to nnake a correct choice,. 
while the other 12 acknowledged that they knew the meaning of 
neither word and had no particular reason for their choice. They 
had chosen one merely to comply with the investigator's request. 
Sixty eight percent of this sample group had failed to get the 
meaning which was intended. Although the illustration carried 
the atmosphere of a very pleasing food and made the advertise- 
ment a good one, another more readily understood *word would! 
certainly have added much to its effectiveness. 

2 To what degree does the copy-writer adjust his ideas to hia 
audience? 

It is quite evident that a person may understand every word 
in a sentence and yet not get the meaning conveyed by the sent^ice 
as a whole, may not get the idea in the mind of the writer. To 
determine the degree to which the ideas presented in an advertise- 
ment are grasped by the public a series of tests was conducted. 
These tests took the form of the Thorndike Reading Tests which 
are designed to measure the degree to which one understands what 
he reads. A passage is presemted to be read along with a series. 
of questions to be answered from the material read. In our tests 
an advertisement in its complete form together with a series of' 
questions was used, or the copy of the advertisement was pre- 
sented in typewritten form together with a series of questions 
bearing upon it. Nineteen sets of material representing different 
advertisements were teste<i on more than 1,000 people. The ad-- 
vertisements ranged in character from the simple Subway Car- 
card to the elaborate automobile advertisements. As it is impos- 
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Bible to present the data for all the advertisements in sufficiently 
brief space, samples will be chosen to illustrate the method and 
the nature of the results. 

One hundred and seven New York Subway passengers were 

asked to read the advertising card for the _ .. Emulsion which 

contained the following copy; 

"Milk is an emulsion. The Emulsion is emulsified 

550 times finer than milk and its fat content is eight times richer 
than the best milk. That is why physicians and druggists all over 
America, when asked to name the finest emulsion, answer The 

— Emulsion. Tastes good — No Cod Liver Oil-Protects and 

Builds Health." 

The following questions were asked and the answers recorded 
by the investigator: 

1. What is an emulsion? 

2. What does "emulsified 660 times finer than milk" mean to 

3. What is it that makes milk an emulsion? 

4. Why does the Emulsion protect and build health? 

The answers to questions 1 and 3 demonstrated that none knew 
the essential characteristic^ of an emulsion, altho 46 percent 
knew that an emulsion was fatty. To others it was merely a 
liquid and to still others it was merely white. Answers to ques- 
tion two showed that none grasped the significance of the state- 
ment. About 30 percent did say that it meant that the 

Emulsion is 650 times better than milk. Although this belief is 
misleading it is not damaging to the product. Sixty-four percent 
believed that this emulsion would protect and build health, be- 
cause "it is better than milk" (24 percent) or because "it is recom- 
mended by physicians and druggists" (40 percent). Although this 
advertisement may be considered effective, there is a great question 
whether the copy-writer really "put his ideas over," and obtained 
the maximum effect possible. 

Forty seven women, all of whom looked like housewives, wei^ 
asked to read the following car card, which is of the simple pub- 
licity sort: 

" Golden Syrup. Made from Cane Sugar. For Table- 

For Cooking." 

The questions asked were: 

1. Why should you buy a can of Syrup? 

2. Why does cane sugar make good syrup? 

3. What other kind of sugar oould be used to make syrup? 
To question one, eighty percent said they would buy it because It 
was made from cane sugar. This was, of course, the only selling 
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argument presented in the advertisement. But in answer to the 
second question it was discovered that no one knew why cane sugar 
would make good syrup. The answers to question 3 showed that 
70 percent knew of no other kind of sugar from which syrup 
mi^ht bs made. Further questioning of those who said they would 
buy this product showed that it was the prestige of the trade 
name that was effective, and that the only actual reason given for 
buying this product had not done its work. , 

Following is the copy taken from an automobile advertisement 
and presented to 55 college men with the request that they read 
it and answer one question about it. 

"Humanity may be a million years old in point of time, but 
it is >3 young as this morning's sun in its pursuit of the ideal. 
Aft€r two thousand years of disappointment and disillusion, the 

eternal verities and the eternal values still prevail Even 

though it be surrounded and seemingly obscured by sham an-1 
pretense, nothing in this world is discovered so surely as solid 

merit This is the truth that embodies all truth; this is 

the truth that makes men free." 

Thirty percent of the group could not answer the question which 
was: What is the truth that embodies all truth? As they did 
not discover that "nothing in this world is discovered so surely 
as solid merit," they could see no connection between this para- 
graph and an automobile ad verti semen t. One person who had 
had experience in copy-writing agreed that "it might be part of 
s poor advertisement for a good automobile." It seemed useless 
to try this paragraph on less intelligent groups of people, who 
at the same time might represent better automobile prospects 
than the group used in our experiment. 

This paragraph was difficult or impossible to understand be- 
cause of its abstract ideas and the complicated character of its 
•construction. Another case studied, that of a doube-page adver- 
tisement for a new safety razor owed its difficulty to the wealth 
of technical details involving a greater knowledge of physics than 
is possessed by the majority of people, even of college students 
who have had the advantage of a caurse in physics. The actual 
advertisement was used in this experiment and its content is 
too long to reproduce in this connection. It is described in some 
detail in another article by the author*. All that need he mentioned 
here i.s that of the 55 college students who were asked to answer a 
series of 7 questions about this advertisement, with the privilege 
of consulting it as often as desired, practically none was able to 

■A. T. PoflBnbemei*. Journal at Appllad PiyeholDKr, 1921. 
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grasp the technical details on which the success of the product 
depended. 

The study of the nineteen cases, of which those given are 
samples, shows that advertising copy both in the vocabulary used 
and in the nature of the ideas presented frequently "goes over 
the heads of its audience." The trouble is frequently hidden in 
one or other of two ways or both. First, the excellence of the 
illustration may overcome the shortcomings of the copy or make 
the advertisement successful in spite of the copy. That copy can 
convey the most abstruse ideas so that they shall be easily under- 
stood, the reading of the masterpieces of literature will show. Sec- 
ond, people may be convinced of the value of an article even when 
they do not understand what is said about it. But since we do 
not know the extent to which this sort of reaction prevails in 
liuman behavior it does not seem safe to rely on' it for successful 
advertising. It is a matter, however, which the student of Ap- 
plied Psychology might well investigate. 

The unfailing remedy for suspected unintelligible copy or copy 
that is difficult to understand is, as suggested in the beginning of 
this paper, a very simple one. It is, "Try it on the audience," 
Take a sampling of that portion of the public to whom the copy 
is to appeal and by a series of questions, carefully prepared be- 
forehand, find out just what is the reaction to the copy. The 
Applied Psychologist who is interested in measuring and predicting 
human behavior in cases of this sort relies upon no general prin- 
ciples to guide him, but resorts to the method of sampling just as 
the chemical engineer or the physical engineer tests his materials 
)iy the method of sampling. And just as in these latter cases, 
skill is required in obtaining the samples, in measuring them, and 
in drawing conclusions from the measurements. 

The advice of Robert Louis Stevenson to "Write so that the 
fool can understand you, and the wise man will understand yon 
also," is, indeed, good, provided that one takes pains to discover 
what the fool can understand. 
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The increased appropriation voted by the Eighty-ftfth General 
Assembly of Ohio to the Bureau ol Special Education and Paycho- 
Educational Clinic of Miami University, has enabled the Bureau 
to increase its staff, to enlarg-e its facilities for training teachers 
and supervisors for special classes for subnormals, delinquents and 
speech defectives, and psychological examiners, and to open a 
branch station in Cleveland. In addition to the director, J. E. W. 
Wallin, the staff includes the following: in the Dayton center, Mra. 
Jessie Wilson, M. A., University of Michigan, and Miss Janet 
Holcomb, M. A., Columbia University; Psychological examiners 
and instructors, Miss Mildred Grimes, B. A., Western Reserve and 
graduate student at Columbia, instructor in industrial arts, critic 
teacher and Miss Eva Nutting, student in the Bureau of Special 
Education, Miami University, critic teacher; and in the Cleveland 
branch, Bertha M. Luckey, Ph. D., University of Nebraska, and 
Treva Wither stay, critic teacher. 

Students are admitted from all sections of the country without 
other charges than a nominal registration fee. 

SrECIAI. EDtrATH>N. tllllO UNIVERSITY. ATHENS. OHIO 

The work in Special Education was established in the College 
of Education of Ohio University, Athens, Ohio, in 1920 in con- 
nection with the Department of Psychology and Paidology. In the 
fall of 1922 this work in Special Education was made a separate 
part of the Training School in order to take care of the Special 
Classes in the City Schools of Athena as well as to meet the calla 
coming from the students desiring practice in schools for excep- 
tional children. Miss M. La Vinia Warner, graduate of Columbia 
University, New York City, ii directing the new department. 

Special facilities were already afforded by Ohio University 
for the preparation of teachers for this line of work because of 
the opportunity for the selection of subjects offered by the 
College of Education and also the College of Liberal Arts to 
which are now added the Special subjects further needed and the 
Special School for exceptional children as a training school. The 
need for special education in the public schools of Athens and 
Athens County affords a wonderful opportunity for the study of 
all types of exceptional children and the social conditions give 
students a good opportunity for the study of and practical ex- 
perience in Social Work. 

A group of fourteen students registered for the work in Special 

Education in the 1922-23 term and thirty-seven students came in 

for the Summer Session of 1923. The demand for the work is 

(870) 
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IfTOwine rapidly throughout the State of Ohio and more calls 
than can be fllled are coming in for teachers trained in this fleld. 

W. V. Bingham has been elected Editor and L. L. Thuritone 
Associate Editor of the Journal of Personnel Research. C. S. 
Yoakum continues as Managing Editor of the Journal which is 
now entering on its second volume. The other members of the 
editorial board are Wesley C. Mitchell, Alice Hamilton, Frank- 
wood E. Williams, R. W. Husband, Matthew Woll, Leonard Outh- 
waite, Joseph K. Willets, Lewis M. Terman, Alfred D. Flinn and 
Uary Van Kleek. 

This Journal is devoted to the scientific study of personnel. 
It publishes original researches in the applied sciences that con- 
tribute to our knowledge and our effective direction of people at 
work. It is the otBcial organ of the Personnel Research Federation 
"whose purpose is the furtherance of research activities pertaining 
to personnel in industry, commerce, education and government 
-wherever such researches are conducted in the spirit and with the 
methods of science. It brings together workers in the biological 
and medical sciences, psychologists, psychiatrists, engineers and 
economists who are making significant contributions to more exact 
knowledge of human beings at work and methods of making effect- 
ive and satisfying adjustments between men and their work. 



BRITISH ASSOCIATION FOR THE ADVANCEMENT 
OF SaENCE 

Toronto Meeting, August 6th to 13th, 1924. 

Dear Sir (or Madam), 

A meeting of the British Association for the Advancement of 
Science iwill be held at Toronto, from August Gth to 13th, 1924. 

The association has recently added to its various Sections a 
Section of Psychology. The OrganisinR- Committee of the Psy- 
chological Section believes that the meeting will afford an unique 
opportunity for intercourse between psychologists of Canada, the 
United States, and Great Britain; and accordingly issues an invi- 
tation to any psychologist in the United States or Canada, who 
may desire to do so, to join the Association as a member for the 
Meeting, and to contribute a paper or attend tlie discussions. 

Professor McDougall, P.R.S., of Harvard University, has ac- 
cepted appointment as President of the Section; and it is hoped 
that he will deliver the presidential address.. Other papers have 
been promised by Dr. Morton Prince, Dr. Brett, Dr. Bott, Dr. 
Bridges, Dr. Sandford, Dr. Tait, by Dr. Myers, Dr. Burt, Dr. 
Drever, Mr. Fliigej, Dr. Miles, Professor Pear, and other leuling 
American and British psychologists. 

Joint Meetings have been arranged with the following Sections: — 

Section H (Anthropology) to discuss "Racial Mental Differ- 

Section I <Physiology)'to discuss "Application of Physiology and 
Psydiology to Industrial Efficiency." 

Section L (Education) to discuss "Tests for Scholarships and 
Promotion." 

Papers should not require more than 20-30 minutes to read; 
and intending contributors should send a notice of their papers 
before the end of March to the Recorder of the Psychological 
Section (British Association), The Psychological Laboratory, "Hie 
University, Leeds, England. Further particulars as to member- 
ship for the meeting can be had from the Secretary, British Assoc- 
iation, Burlington House, Piccadilly, London, W.I., England; and 
notices of the general arrangement will be issued in due course by 
him and by the Hon. Local Secretary in Toronto. 
We are, 

Yours faithfully, 

LL. WYNN JONES, Recorder, 
CYRIL BURT, President (1923) 
W. McDOUGALL. President (1924). 
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Albert S. Osborne, The Problem of Proof, pp. xxii + 528. 
Matthew Bender & Co., New York and Albany, 1922. 

Students of legal psychology should have access to this volume 
by the distinguished author of "Questioned Documents." Mr. 
Osbom has been a close student of human nature, especially as ha 
has observed it in trial lawyers, judges, jurors, witness, litigants, 
and criminals. He understands perception and memory, reason- 
ing and emotion, sugijestion and persuasion, credulity and deceit; 
and he has here put down the rich accumulation.s of his wisdom 
for the eoidance of trial attorneys and the furtherance of justice. 

Of the twenty -eight chapters, the psychologist will especially 
enjoy these: Sifting the Evidence, The Atmosphere of a trial, 
Crosa-Exami nation, Memory and the Proof of Facts, Advocacy, 
Persuasion and Practical Psychology in Courts of Law, Form 
Blindness, The Designing and Lighting of Court Rooms, and Ths 
Judge in Disputed Document Trials. The vocational counsellor 
and the prospective attorney should read, beginning on page 234, 
Mr. Osborn's description of the requirements of the great lawyer. 
Carnegie Institute of Technology. W. V. Bingham 

Helen T. Woolley and Elizabeth Farris, Diagnosit and Treat- 
ment of Young School Failures, Bulletin 1923, No. 1, p. 116, 10 
cents. Department of Interior, Bureau of Education, Washing- 
ton, D. C. 

Both the teacher and the psychologist will appreciate this 
picture of what may be accomplished with young school failures. 
Various mental and educational tests were used in selecting the 
sixteen children for the "demonstration class." The children in 
the class varied in chronoloidcal age from six years and seven 
months to ten years and four months, and the intelligence quo- 
tients of the first test varied from seventy-five to ninety-five. 

The children were grouped for study into four dominant causes 
of their difficulties, as neglected children; high-grade defectives; 
special defects in some one subject; and psychopathic children. 
Each type is reported in the bulletin separately and each 
case is very completely reported, giving many helpful points in 
understanding such children. 

The entire article is a plea for proper treatment and classl- 
flcation of exceptional children. One of the best arguments for 
Special Education that is ahovra in the bulletin is found in the 
discussion of the changed attitude of the children towards school 
and life. This is certainly worthy of consideration. Another is 
that the intelligence quotients of these children increased with 
the superior teaching. 
Ohio University. M. La Vinia Warner 

Bernard C. Ewer, Applied Pachology pp. xii-|-480. Macmillan 
Co., N. Y. 1923. 

Psychology must be saved from her friends. Like many another 
weiUfavored jade of popular acclaim, she is in danger of having 
her name become a by-word and a term of reproach to be thrown 
in the teeth of her too much preoccupied guardians, the zunft of 

(373) 
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Psj^cholo^sts properly F.peaking. WMle they are ene-aged in 
cautious, painstaking effort to extend their own knowledge con- 
cerning her mysteries, interlopers and charlatans of all sorts are 
g7«edily capitalizing the credulity of an uniformed public, to the 
ultimate harm of both the public and the lady in question. 

To show that she's not at all that kind of a gal is the raiton 
d'etre of the volume here under review. To give the author's own 
statement, "There is a lack of literature which attempts to present 
in a readable form the principles, methods, and results of scientific 
psychology as applied to problems of everyday life." 

For those at all informed the author's thesis needs no more than 
its statement to be accepted. Book shops, magazine stands, pop- 
ular lectures by "mentalists," all are more or less shamelessly 
vending under the name of Psychology various nostrums concocted 
at best under the animus of ignorant and misguided enthusiasm, 
at worst with cynical disregard for intellectual decency and with 
unscrupulous motives of gain. The method and techiques of 
science are caviar to the general, who as a rule prefer food of a 
different sort. Any effort such as the volume by Professor Ewer 
to cultivate a more discerning taste is wholly commendable. How- 
ever much psychologiata may differ as to details of method and 
interpretation — and that honest differences of opinion do exist 
no one will deny — there can be no disagreement on the general 
point of view espoused in this boolc, the point of view of any 
scientific discipline. 

The book is divided into four parts. Part I gives a treatment 
of Aims, Principles, and Methods. After a brief survey of pro- 
cedures and tecnniques as related to the aims of psychology a 
clarification of the concepts "subconscious," "unconscious," and 
"suggestion" are attempted. Part II deals with Education and 
Everyday Life — a sketch of what is ordinarily thought of as 
coming within the purview of educational psychology. Under 
Mind and Health, the general heading for Part III, the author 
treats those things which are probably most frequently as- 
sociated with the term "psychology" for the layman— psych onaly- 
sis, psychotherapy in general, faith healing, etc. Part IV con- 
cerns itself with a survey of the methods and problems of psy- 
chology as applied to industry and commerce. 

Probably any such popular introduction as this must be un- 
satisfactory from the standpoint of the special student. This 
would doubtless be true of sciences much l>ctter organized than 
psychology. A wise friend of the reviewer once defined all 
teaching as being a process of judicious lying. All of us who are 
engaged in the art necessarily have our individual notions as to 
wnat should be emphasized and what omitted. Since the book 
makes no pretense of being a compendium of all knowledge psy- 
chological, however, no strictures can properly be applied where 
the matter is still one of opinion among those qualified to judge, 
but only when questions of fact arise. 

One rather serious lapse in this connection is the statement 
that the coefficient of correlation "in common use known as 

6sumd' 
'Pearson's coefficient of rarrelation is ." This formal* 
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A few other poitita on which psychologists might honestly differ 
may be briefly mentioned. (1) The history of the two terms 
"unconscious" and "subconscious" has not been such as to throw 
all the obloquy of representing a mythical potency rather than a 

.scientific concept upon the former, as the author is inclined to do. 
The argument here reminds one of Mephistophelea' advise to the 

. student in Fauat to battle onl^ with words. 
"Denn eben wo BegTitFe fehlen 
Da stellt ein Wort lur rerhten Zeit sich ein," 
(2) "Subconsciousness works meckanicaii^. It acts with a re- 
gularity of cause and effect which is distinct from rational self- 
direction and inhibition." Query, aside from the question of fact: 
is a Bcience of psychology possible on any other basis than mfirh- 
anistic postulates? (3) To subsume under the general heading 
of "special intelligence tests" such a diversity of tests as as- 
sociates tests and special achievement tests of all sorts (educa- 
tional tests) tends only further to befog an already very cloudy 
issue — especially for the lay person. (4) The attempted dis- 
tinction between individual and "social" suggestion might be 
questioned. (5) "What is needed [in regard to religious pay- 

cnotherapy] is a more studied practice of superposing religioua 

faith upon medical care." (6) There is a Mon tequitur in the ar- 
gument for the hereditary mental similarity of siblings (r of .40 
to .75, which means 10 to 30 per cent better than a sheer guess) 

tiarticularly when the author advances this argument: "Eapee- 
ally in twins is the mental similarity conspicuous, and since it 
is not substantially greater in older than in younger twins it . 
cannot be ascribed to education." The relative weight of heredity 
vs. environment is not demonstrated in such figures, or by such ar- 

fument. (7) In view of the fact that "Freudian psycholo^" ia 
eprecated so generously— and some of the psychoanalytic lit- 
erature certainly warrants this — it would seem to have been only 
fair to have difterentiated more carefuly between the pronounce- 
ments of Freud and those of some of his over -enthusiastic fol- 
lowers. "The recommendation of its [Freudian doctrine] extreme 
advocates that one should refrain altogether from interfering with 
the emotions" is certainly counter to what Freud explicitly states 
in his General Introduction to Psychoanalysis — which the author 
lists in his bibliogrraphy. 

With all these strictures the present writer feels that the book 
has a legitimate place. The intelligent layman and the beginning 
student should find it of value. Part IV on. Industry and Com- 
merce is particularly well done, and the chapter on Social and 
Moral Factors faces some of the larger problems involved in 
human adjustments. 
Purdue University HERMANN REMMER9 

Donald A. Laird, Ph. D. Applied Psychology for Nurset pp. 
xi-l-236. J. B. Lippincott Co., Philadelphia, 1923. 

In this little volume the author has "selected from the vast 
literature of psychology those facts of most immediate aid to 
nurses in understanding the patient, themselves, and their fellow- 
men," as announced on the paper cover. I should say that he 
has done more than that; he has gone further into the preserves 
of biology than many psychologists would venture — a procedure 
quite commendable, I believe. 

Written in popular, newspaper English, the book should commend 
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itself to those with the amount of preliminary training that the 
ordinary nurse has, as well aa beginning students of psychology 
generally. The advanced student may be a bit irritated or even 
slightly scandalized at the i r re ve ranee manifested toward the- 
household gods of psychology in some of the chapter and section 
headings — e.g., "Enter the Villain"; "A Practical Joke on a Sea- 
Anemone"; "The Moon and the Devil Blamed." 

As already intimated the book is biological and behavioristic 
in viewpoint. It is divided into four parts. Part I attempts to 
orient the student with respect to the origin, scope, and applications- 
of psychology, with particular reference to medicine and nursing; 
this is done in twenty-five pages. In Part 11, the most technical* 
part of the book, the author treats the biological aspects an<f 
foundations of behavior. Part III, entit'eil "Applications," is the 
piece de resxstwnee : learning endicronology, temperaments, in- 
stincts, psychoanalysis, suggestion, — these, although not all called" 
by their first names, indicate the rubrics under which the dis- 
cussion may be classified. Part IV is given over to somewhat more 
general, sociological applications of psychology and psychiatrr^ 
with particular regard to the subject of mental hygiene. 

The author states in the preface that he has "endeavored to 
avoid all controversial matter not borne out by fact," and hav 
succeeded in the main. The chapter on The Temperaments in 
Nursing, however, offers opportunity for polemic to one contro- 
versially inclined. The ancient classification of the temperainent*; 
could well be improved from the modern point of view of abnor- 
mal psychology. To trace the inheritance of these varioos traita- 
as unit characters (p. 126) seems to me more than qae^ionsble;. 
the study of the Eugenics Record Ofllce, which the author quotes, 
notwithstanding. Any mention of the glands of internal secretion! 
upon behavior also opens up another debatable question. It is" 
only fair to say, however, that the author treads rather lightly- 
here. 



of this sort to make it a valuable adjunct in the training of 
nurses. The portions of the book dealing with mental hy^ens- 
and the applications in general are well worthy the attention' of 
the lay reader and heginning students generally. Unconvention- 
ally written aa the book is, I am not prepared to state that this 
is a fault rather than a virtue. 
Purdue University Hermann Remmers 

Mead, Akthuk Raymond. LeamiTig and Teaching. Lippencott 
Company, 1923. Dp. XI and 277. 
Learning and Teaching, as the title suggests, is « study in 
applied psychology. The author has endeavored to cause the 
student of education to apply the general laws of psychology to. 
a great variety of class-room problems. He has consciously at- 
tempted to do something that will aid in removing the source 
of much criticism against present-day teaching of psychology 
and education in our modem teacher-training institutions. There, 
is the persistent criticism, often very bitter, that instruction in 
psychology and education fails to carry over from the teacher- 
training institution to the actual teaching of boys and girls. It^ 
is this criticism that has prompted Professor Head to offer the: 
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teachers of this country a new book on the subject. 

Professor Head has devoted one half of his 277 paf^es to 
exercires and reterences. These exercises and refercncES tover a 
wide range of topics. Anions' the topics considerrd are the follow- 
ing: The nature of human learning, the geneitil End ind'vidual 
factors that influence learning, the transfer of learning, the meas- 
urement of mental functions, psychological conclitiojis concerned 
with the elementary and secondary curricula, and the psychological 
condition involved in educational methods. These topics receive 
a minimum of iliscussion. In fact the discussion of the text fre- 
quently is too limited to give the student adequate knowledge of 
wie principle under consideration. Suth informat'on, however, may 
be readily gathered by the student from the excellent listi of 
references appended to each topic. This approach to the subject 
is familiar to those acquainted with the Principles of Teaching by 
Professor Thomdike.. The merits and limitations of such an ap- 
proach are apparent. 

Professor Mead has done students of education a real service 
by collecting this extended list of varied exercises and by care- 
fully selecting references bearing on each topic. The exercises 
show discrimination in their selection and arrangement, and with 
the proper use of the suggested references, should give satis- 
factory results. 

L00SM<»(E, W. Charles. The Gain of PersonaHty. E. P. Duttan 
& Co. pp. 233. Price $2.60. 

The Gain of Personality is a popular psychological statement 
of the practical values of personality. In the course of his dis~ 
cussion, the author has treated the nature, elements, and general 
development of personality. Each of the three major divisions 
is analyzed into its component parts. Under the general head 
of element of personality we find such sub-divisions as individ- 
uality, sincerity, courage, enthusiasm, sensibility, self-expression, 
humor, and repose. 

The book offers clear evidence that the author is acquainted 
with books and men. He states his position clearly and with 
effectiveness. Throughout he directs the reader's attention to 
those elements in the life of the individual necessary for suc- 
cess. He points out wherein many people fail, and indicates 
the elements necessary to success. 

In brief the mission of the book is not to discuss personality 
"theoretically or philosophically" but "practically and help- 
fully." A reading of the book should aid the individual in 
taking stock of his personal merits and limitations. 

WeU-S, George Ross. Youth and the Open Door. E. P. Dutton, 
1922. pp. 175. Price $2.00. 
The book contains a series of lectures originally delivered to 
freshmen in college. The purpose of the author is to present 
to young students certain laws of mental life whereby they 
may realize the largest benefits possible from their four years 
in college. With this point in mind, the author has discussed 
instinct, habit, remembering, attention, interest, thinking, emo- 
tions, causes of failure, choice of vocation, and character and 
temperament. The discussion of these topics is non-technical 



378 BOOK REVIEWS 

in character, and ia deaigned to make effective certain laws 
of paycholog'y. The author's psyeholo^ is modem and its 
application to the task in hand is clear and judicious. 

The reader turns away from the book with the feelin)f that 
the effort of the author has been worthwhile. He has pointed 
out certain aids in the use of the mental powers that can not 
fail to benefit the student. It is certainly the type of book 
that should find its way into the hands of our youth who 
desire tc make economc use of student days. 

On the whole the book is well written and places its message 
hefore the reader in an effective manner. 

In brief it is an effort to apply lessons of psychology to the 
very processes which make possible psychology. 

Hoke, Koy Edward. The Improvement of Speed and Accuracy in 
Tifpeumting. The Johns Hopkins University Studies in Edu- 
cation, 1922. pp. 42. Price 75c. 

Experimental studies in learning typewriting are not num- 
erous. Book's well-known study concerned itself chiefly with 
the psychology of skill. He did not stress the improvement of 
speed, accuracy, or methods of teaching typewriting. 

In his study. Dr. Hoke has selected five definite questions 
for investigation: First, an investigation of the frequency of the 
occurrence of letters and marks used in the English langTjage; 
Second, an examination of the number and distribution of errors 
made in actual typewriting, and in so far as possible determine 
the causes of the error.s; liiird, a study of the relative abilities 
of the eight fingers and of the two hands; Fourth, the determi- 
nation of the loads or burdens of work placed by the present 
system upon the fingers and hands; Fifth, an attempt to point 
out the consideration which must be admitted in an effort to 
arrange a keyboard on scientific principles. 

The study closes with a suggested keyboard together with 
certain criticism of the proposed changes in the keyboard. There 
is appended a bibliography of twenty-six titles. As would be 
expected most of the titles discuss the more general problem of 
the acquisition of skill. 

To the reviewer the study deserves careful consideration by 
those interested in teaching typewriting and who are anxious 
to produce a- product with the highest skill and accuracy. It at 
least suggests a method of approach of investigating ways and 
mean^ of improving skill in one of the most widely used skills 
of man. 

Hoke, Elmer Rhodes. Thf Measurement of Achievfrnt-nt in 
Shorthand. The John? Hopkins University Studies in Educa- 
tion, 1922. pp. 118. Price $1.50. 
Id this monograph Professor Hoke gives an account of four 
scales that he ha.s constructed for use in connection with teach- 
ing Gregg Shorthand. The author recognizes the fact that the 
use of shorthand is a complex process, involving mental and 
motor factors. In his analysis of the process, the author selects 
four important aspects for consideration. These important aspects 
are reading ability, quality of writing, speed of writing, and 
Icnowledge of the system. A separate scale has been conatructed 
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for each of the four itema. Samples of each scale are printed 
in the appendix of the monof^'aph. Tentative norms for each 
have been determined. It is the authors belief, and no doubt 
wiUi a great deal of justification, that such scales in the hands 
of teachers of shorthand will result in better methods of teaching^ 
and consequently better qualified users of shorthand, 
Ohio University WiLus L. Gard 
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*MeDtlon here does Dot preclude lurlher comment. 
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